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[57] ABSTRACT 

This invention provides mechanisms that detect the 
large dynamic range of r adiant intensities in the natural 
environment, that use novel strategies to calculate an 
approximation of visual properties of objects, and that .? 
represent a scene with an image havin g a s pecific _dy- 
namjg_rangej]iat is optimal for display media such as 
pE&to^raj^yTtelevision and printing. 
Photographs and other images are made according to 
the foregoing mechanisms from lightness fields pro- 
duced from multiple comparisons between information 
associated with a different segmental areas of an image 
field. Different comparisons involve different groups of 
segmental areas, and different groupings have at least 
one spatial parameter different from other groupings of 
areas. Comparisons advantageously are made in succes- 
sion with an ordered sequence of the spatial parameter 
and employing results of prior comparisons. 

86 Claims, 21 Drawing Figures 
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display that includes reference areas covering the range 
METHOD AND APPARATUS FOR LIGHTNESS from minimum to maximum reflectance in controlled 
IMAGING illumination and surround. One then presents an ob- 
server with another area in any viewing condition and 
BACKGROUND OF THE INVENTION 5 asks the observer to select the best visual match of that 
This invention relates to the art of creating and of area t0 a reference area of the standard display. Finally, 
processing images. It provides a method and apparatus 0Iie takes the reflectance of the chosen reference area 
for computing or processing visually perceptible images and typically applies a monotonic scaling function so 
in terms of a lightness field. A lightness field is herein that equal increments in the resulting lightness numbers 
defined as the output of a process that uses radiances 10 are assigned to equal changes in sensation. Such ap- 
falling on a light-detector from an original image to proach emphasizes the fact that although lightness is a 
produce a new set of values that correspond to the sensation produced by a human or other biological 
sensations of lightness produced by the human visual system, it is a quantifiable entity. The correspondence in 
system. reports from large numbers of observers in numerous 
Vision science begins with the basic properties of 13 experiments of this type shows that these sensations are 
light, for which there are clearly established quantita- generated by a repeatable set of physical relationships, 
tive concepts tied to physical measures. For example, Since lightness depends on the entire image, a physical 
the radiance from a given region denotes flux of radiant * definition of lightness must incorporate a process which 
energy per unit projected area per unit solid angle. utilizes the entire field of view. 
Reflectance of a surface denotes the fraction of incident 20 The teaching herein describes signal processing sys- 
radiant energy (of a specified wavelength distribution) tems wnich generate quantities that correspond to light- 
reflected by the surface. ness> The quantities, however, are generated by ma- 
Less consensus has developed m characterizing chine signal proofing systems rather than biological 
human reaction to light, and it is not surprising that a systems. For clarity we define a separate term to de- 
term such as lightness, which generally ^refers to a sensa- 25 these machine _ generated quantities that corre- 
t!on, has at different times been assigned different mean- g d to lightxiesSt We have chosen tne term "lightness 
ings. Thus , m Webster s New InternaUonal DicUonary, field „ ^ ^ Rame of ^ of ^ for ^ 
Second Edition, lightness was defined as the state or selected field of yiew ^ the fact 
quality of illuminator ioi -degreeof illumination, i£,a fa ^ ftM . derived from £ ^ ^ 
physical measure. In Webster's New International Die- 30 . & *\ * 
Senary, Third Edition, lightness in addition denotes a °P™}">™ ^ inv f\ c A ^ field ° f view ; 
sensation, namely, "the ^tribute of object colors by ° f h ^ tae ? s f,eld computation distinguishes it 
which the object appears to reflect or transmit more or *?T °* e f "P* strategies that involve 
less of the incident light and which varies for surface P 01 ^ or lo f d ' f»» of *f image. 

colors from black as a minimum to white as a maximum. 35 Human ™ 10n 18 reMrk f ble ** to S en 5 rate r 

♦> sensations that correspond to the physical properties of 

' The later definition recognizes the importance of ob ^ in the field of view regardless of the radiant 

appearance, i.e. the sensation. Sensation is important intensity and of the wavelength distribution of the light 

because the lightness of an object is not necessarily fallm S on tne retma - ^ wavelength-intensity distribu- 

related to the physical quantity of light from the object, 40 tlon of the h g ht from «* faIlin S on a light detec- 

either in radiometric or photometric terms. An object tor such ■» a photosensitive element is a function of two 

will hold its position on a lightness scale despite large independent variables: the illumination at the object and 

changes in its intensity. Much of the difficulty in termi- the ability of the object to reflect or transmit light. 

nology thus arises because visual sensations characteriz- However, the radiance measurements for any single 

ing a specific region cannot be directly related to any 45 P"*ure element, Le pixel, are not subject to an analysis 

physical measure of light from that region alone. w *>jch identifies the independent contributions of lllumi- 

The term lightness as used in connection with these nation and of object properties, 

teachings will have a primary meaning of a visual sensa- This invention, on the other hand, uses the entire field 

tion as produced by biological systems such as human of view to calculate visual properties of objects substan- 

vision. These lightness sensations are produced by a 50 tiallv independently of the properties of the illuminant 

biological system that takes the radiance at each point in Using the entire field of view is considered essential to 

the field of view and yields a lightness value for each a solution of the problem that cannot presently be 

point in the field of view. In particular, lightness de- solved by processing information at individual pixels 

notes a visual sensation which ranges from dark to light independently of that at other pixels, 

and which characterizes image regions in specific con- 55 It is difficult for a photograph or like image to accom- 

ditions. One of the more interesting properties of human modate variabilities of lighting conditions, even when 

vision is that the cerebro-retinal lightness signal pro- care is taken to center the limited dynamic range of the 

cessing system is such that the lightness sensed at any image medium on the dynamic range of the light being 

point does not have a simple functional relationship to recorded. Consider the light reflected from a collection 

the radiance at that point. Lightness thus does not de- 60 of different colored and textured objects, ranging from 

pend on the physical properties of single points or ob- the brightest white to the darkest black, when special 

jects in the field; lightness instead depends on relation- effort is taken to illuminate the collection so that the 

ships between physical properties of all the points or same intensity of light of the same spectral composition 

objects across the field of view. Lightness does not falls on each point in the field of view. The dynamic 

result from point by-point processing; lightness results 65 range of the light reflected from this collection of uni- 

from processing the entire field. formly-illuminated objects is significantly less than a 

Lightness can be quantified by employing a technique range of 100-to-l. The brightest white objects may 

of visual comparisons. First, one establishes a standard reflect roughly only 92% of the light falling on them, 
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whereas the darkest black velvet objects may reflect a complex original scene is provided in the form of a 
roughly at least 3% of the light falling on them. The recorded and displayed television-image. This image is 
light reflected from objects having matte surface falls in full color and portrays a wide range of hues occur- 
between these extreme values for bright white and for ring in varying densities, for example, a woman in a 
black velvet. 5 colorful costume against a bright multicolored floral 

These physical properties of objects limit reflective background, 
reproduction media, such a photographic prints and In each experiment a control image is described 
printing, to a like dynamic range, i.e. to a range signifi- which represents the response to each original scene of 
cantly less than 100-to-L a conventional photographic system that does not em- 
Howe ver, the dynamic range of intensities from real 10 ploy this invention. The first such control image dem- 
life, Le. from natural images, is far larger than that in onstrates the mismatch commonly encountered be- 
this special uniformly-illuminated experiment Natural tween the dynamic color range of an original scene and 
scenes include sizable variations in the dynamic range of the limited color response characteristic of color film, 
the illumination. First, natural illumination varies both For example, highlights exhibit a degree of levelling 
in overall total intensity and in local regions because 15 and desaturation, whereas shadow areas show little 
some objects are shaded by others. Second, the spectral evident image detail. In the first experiment of the in- 
composition of the incident light may vary dramatically vention, the same original scene is subjected to lightness 
from skylight to sunlight to tungsten light to fluorescent analysis by the lightness imaging system defined below 
light. As rioted, human vision is remarkable in that it and is photographed on a standard photographic me- 
generates image sensations which are nearly indifferent 20 dium. This first processed image is found to possess 
to this extreme variability of lighting conditions. These much clearer image detail in shadow and in highlight 
same variations in illumination, however, produce areas, a better defined range of color values, and im- 
marked and usually detrimental results in conventional proved saturation. To the eye of an observer, the pro- 
image-reproducing systems, whether photographic, cessed image more accurately represents the content of 
television or printing. 25 the original scene than does the control image. In pro-. 

The present invention endeavors to resolve these ducing the processed image in this first experiment, as in 
imaging problems. More particularly, this invention the others described below, the only image information 
provides mechanisms that detect the large dynamic available to the lightness imaging system is that which is 
range of light intensities, that use a novel strategy to contained within the original scene itself, 
calculate approximations of visual properties of the 30 In a second experiment, the same original scene used 
objects in the field of view, and that" represent the entire in the first experiment is modified by the superimposi- 
jm age in a limited dynamic range that is optimal for tion of a ten-to-one illumination gradient from one side 
niCola sucfi as photograpny, television and printing. A of the scene to the other. When this modified scene is 
significant feature of the invention accordingly is the photographed, using conventional techniques to pro- 
calculation of lightness fields that portray large dyan- 35 duce a control image, most of the image detail is lost in 
mic ranges of the original scene in terms of limited the darkest portions of the image, or in the brightest 
dynamic ranges defined by the range of intensitiies avail- portions, and most of the color, values are lost. But 
able in various media. when this modified scene is analyzed and photographed 
Various photographic defects result from attempting using the lightness imaging system of this invention, a 
to photograph the natural environment "as is". Ordinar- 40 second processed color print is obtained which is virtu- 
ily the photographer consciously tries to avoid or mini- ally indistinguishable from the first processed image 
mize these defects by the practice of his art He mea- described above. The ten-to-one illumination gradient 
sures the light coming from the objects in the scene and has disappeared, and the resultant image displays the 
adjusts the time and the aperture settings so that the same saturation, image detail, and pleasing dynamic 
exposure will fall on the desired portion of the limited 45 range as that of the first processed image. Furthermore, 
dynamic range of the film* He artificially illuminates all this second processed image is obtained by the same 
or part of the scene to compensate for non-uniformities lightness imaging system operating in the same way and 
in illumination across the scene. He uses color-correct- with no further modifications, adjustments, or revised 
ing filters to match the spectral properties of the scene programming. 

to the spectral sensitivity of the film. The photographer 50 A third experiment is performed- The original scene 
makes these corrections in part by estimating the physi- is now subjected to different modification representing 
cal properties of the illumination, perhaps with the aid tungsten illumination of the scene. As a consequence, 
of a light meter. A television cameraman and his crew the intensity of the middle-wavelength illuminant is 
follow similar procedures. Further, present-day auto- only 41% of that of the long- wavelength flluminant, 
matic cameras determine the lens aperture and the shut- 55 and that of the short-wavelength illuminant is a mere 
ter time settings, but they do not do all that is necessary 5% of that of thelong- wavelength illuminant. An ordi- 
to correct the range of lighting problems found in a nary photograph of this modified scene is strongly red- 
natural environment dish with few discernible green color values and with 
The power of the concepts set forth herein can be practically no visible blue color values. However, when 
illustrated by the following practical experiments dem- 60 this modified scene is processed by the lightness imag- 
onstrating advantages realized and realizable in one ing system, operating in the same unmodified way, a 
practice of this invention. The description is of six ex- third processed color print is obtained which is virtually 
periments that emphasize typical common handicaps indistinguishable from the first two. 
presently encountered in photographing complex im- Then in a fourth experiment, the original scene is 
ages. Typical photographic defects result from the mis- 65 subjected to both of the illumination modifications em- 
match between the dynamic color range of an orginal ployed in the second and third experiments. Thus, not 
scene and the limited color and intensity responses of only are the color values of the entire scene altered by 
photographic materials. For the following experiments, a tungsten illuminant, but the illuminant varies by a 
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ten-to-one gradient from one side of the original scene Other publications in the imaging art are the article 
to the other. A conventional photograph of this modi- by T. G. Stockham, Jr., "Image Processing in the Con- 
fied scene is strongly reddish with few discernible green text of a Visual Model", Proceedings of the IEEE, Vol. 
color values and practically no blues, and all the image 60, No. 7, July 1972, pages 828 through 842; the article 
detail appears lost in the darker portion of the illumina- 5 by David Marr, "The Computation of Lightness by the 
tion gradient. At this point it should come as no surprise Primate Retina", Vision Research Vol. 14, pages 1377 
to learn that indeed the fourth processed image obtained through 1388; and the article by Oliver D. Faugeras, 
by the apparatus and method of this invention is not "Digital Color Image Processing Within the Frame- 
only essentially free of the imposed modifications, but is work of a Human Visual Model", IEEE Transactions on 
substantially identical to the first, second, and third 10 Acoustics, Speech, and Signal Processing, Vol ASSP27, 
processed images. No. 4, August 1979, pages 380-393. This invention em- 

A common problem in photography, different from P lovs techniques which differ significantly from the 

those already considered, is that of preserving image image processing which these articles discuss, 
detail in distinct areas of a scene that has different over- Objects of this invention, and advantages which it 

all levels of illumination. Two additional experiments 15 brings to the art of imaging, include attaining tightness 

are described with a new original scene that shows a imaging with fewer signal processing steps or computa- 

household interior in which a person is seated by a tions in considerably less time then previously available, 
window onto a colorful outdoor view. A further object is to provide a method and apparatus 

In a fifth experiment, the new original scene is char- for Illness imaging applicable on a practical basis to 

acterized by an eight-fold reduction in the illumination 20 numerous image processing and numerous image creat- 

of the view outside the window; that is, this modified ing mstanc es- 

original scene depicts the illumination of an evening. Another object of the invention is to provide a 

When this evening scene is photographed, with the m ethod * nd apparatus for providing an image, termed a 

same conventional practices previously used to produce Kg 1 * 11685 image, which represents a scene in a limited 

a control image, most of the image detail and color 25 dvnamic ran S e that is optimal for display media such as 

values in the outdoor portion of the scene are lost. But P hoto 8 r f P h y. television and printing, 
when this modified scene is analyzed and photographed 11 '. s , m . ^J 6 ** t0 P rovid e image processing that 

using the lightness imaging system of this invention, a ^ «nf°rmation acquired at one segmental area of an 
fifth processed color print is obtained in which the ln " ima f 1 m evahmtln S ™fcnnati°n acquired at other seg- 

scene is accurately represented both inside and outside 30 "2* f. r ^ m * ] 5fW | * c manner that attains a 

the window with the same improvements in image qual- ^LXr^ - m aUvdy SmaU *** and ™ ih 

ity described for the previous experiments and in which ^U* ^ * 

the outdoor view still appears somewhat darker, as is J£ ^ an °£ eC \ t0 P™de method and apparatus 

true of the evening setting™ „ f ^ above character SUIted ** commercial apphca- 

t • *i_ * a. ... . . 35 tion. 

JrrlTL'^ZTL*?^,™^ T • Ofbtr objects of the invention will in part be obvious 

TtiftJL g r rT m I ,Uunun f t,on and will in part appear hereinafter. 

of the indoor scene in front of the window with no 

reduction in the illumination of the outdoor view be- SUMMARY OF THE INVENTION 

STJJi!!!! ^?t*° W ' ^ T rCpr ? 40 The P ractice of * e ™tion enables one to produce 

darker LT^i^n M ^VTT* » a W that is ™'°*» to human vision be- 

St£ nf 1 ^ tH !f ? T"Z " * rc P rescnts * a l^ted Vamic range the much 

^Z^ 1 ^^^^ ^ T!f i e T [ t nd ^ d y namic «V 0f radiances found in the natural 

S^KS ~ ifT P ^ w It ^ environment. Media using lightness fields produced in 

his modified scene is analyzed and photographed using 45 this way can ha ve a far ^ f lde ]i t y then previ- 

the lightness imaging system of this invention, a sixth ously available on a repeatable basis. Further, the media 

processed color pnnt is obtained m which the scene is images be essentially free of defects such as illumi- 

accurately represented both inside and outside the win- nation ^ imbalance( ^ other spectral 

dow with the same improvements in image quality de- mismatches 

scribed for the previous experiments and in which the 50 In accordance with the invention an image is pro- 
indoor scene appears somewhat darker, as is the actual duced from multiple comparisons between radiance 
case for a daytime setting. information at different locations of an image field. The 
Furthermore, the fifth and the sixth processed images different comparisons are made between different 
are obtained with exactly the same lightness imaging groupings of locations, and at least some groupings 
system operating in exactly the same way as for the first 55 involve locations characterized by a spatial parameter 
four processed images. different from that of other groupings. 

The invention thus advances the art of retinex pro- i n further accordance with the invention, information 

cessmg as disclosed in the literature, examples of which is provided, for example by viewing a scene with an 

ar iT co mi «<» optical detector array, identifying the radiances associ- 

U.b. Pat. No. 3,553,360 ated with arrayed sections of an image field. Multiple 

U.S. Pat. No. 3,651,252 measures are made of transitions in the radiance infor- 

E. H. Land and J. J. McCann, "Lightness and Retinex mation between each segmental area of the image field 

Theory", / Opt Soa, Am, 61, 1-1 1 (1971). and other such areas of the field. The several measures 

E. H. Land, "The Retinex Theory of Colour Vision", involve groupings of each area with other areas in a 

Proa Royal Inst ofGr. Brit, 47 (1974). 65 way such that the areas of different groupings differ in 

J. J. McCann, S. P. McKee and T. H. Taylor, "Quan- at least on spatial parameter. The different grouped 

titative Studies in Retinex Theory", Vision Re- areas cover different sectors of the viewing field and 

search. 16, 445-458 (1976). consequently can be areas separated by different dis- 
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tances, areas separated along different directions, and The resultant from this operation is the desired measure 
areas of different sizes. These measures— produced in for that pair of pixels. This further step is desirable 
response to radiance information and from such differ- because it increases the rate at which radiance informa- 
ently grouped segmental areas of the viewing field — are tion is accumulated from different pixels. It hence de- 
combined to provide the desired lightness information 5 creases the number of computational steps needed to 
for the entire image field. attain a lightness image. 

The measures of transition in radiance information More particularly, each radiance-transition measure 

preferably are determined for different groupings of for a pixel contains information regarding the lightness 

segmental areas according to a sequential ordering generating property to be provided at that location in 

which proceeds, for example, from groupings of maxi- 10 the resultant image. An objective for lightness imaging 

mum spatial parameter to groupings of progressively in accordance with the invention is to compare the 

smaller spatial parameter. This sequential ordering has radiance information for each pixel with that of substan- 

been found to diminish the level of unwanted artifacts in tially all others and thereby determine the lightness 

the processed image. property which each pixel has in the complete image 

A feature of the invention is that it produces an image IS field. The output of this process for all locations is the 

from multiple comparisons between radiance informa- * lightness field. The repetitive replacement of the reset 

don at different locations in an image field by proceed- ratio product information for one pixel in each pair 

ing on a field-by-field basis. Each iteration of the pro- accumulates this information relatively slowly. The rate 

cess, in the illustrated embodiments, makes new com- of information accumulation is increased significantly 

parisons for essentially all locations in the entire field. 20 by combining the reset ratio product from one iteration 

This is in contrast to a prior practice in which each basic with the measure previously determined for or assigned 

operation provides a new comparison for only one loca- to one pixel in each pair, and using the combined mea- 

tion. sure for the next iteration, i.e. in the next pairing of that 

Another feature of the invention is that it produces an pixel, 
image from multiple comparisons between radiance 25 To this end, a preferred embodiment of the invention 
information at different locations in the image field by provides that each reset ratio product measure of a 
also using a combined reset-pooling technique. The transition in radiance information be combined accord- 
technique enables image information accumulated for ing to an arithmetic averaging function with the prior 
each location to be used in evaluating image informa- measure assigned to the other pixel of that pair. This 
tion for other interacting locations. 30 pooling of information provides a geometric increase in 

It is also a feature of the invention that the multiple comparisons of the radiance information of different 

image-producing radiance comparisons combine local pixels from each measuring iteration to the next measur- 

image information with information from more distant ing iteration. Consequently, it markedly decreases the 

parts of the image. This local-global computation at- number of iterations required to produce an image, and 

tains a lightness field of desired quality with relatively 35 thereby contributes to a new fast rate for image produc- 

few computations and in relatively short time. tion. The combination of this pooling of reset ratio 

Yet another feature of the invention is that it com- product measures with a selected sequential ordering of 

bines the foregoing field-by-field computations, infor- pixel pairings for effecting the measurements yields 

mation accumlation by reset-pooling techniques, and compound advantages in accumulating information for 

local-global calculations to accomplish in real time all 40 the creation of lightness images, 

calculations for imaging complex natural scenes. In a preferred practice of the pooling embodiment of 

In the embodiments described below, the groupings this invention, the imaging process accumulates infor- 
of segmental areas are pairings, i.e. each involves two mation in a learning-like manner. The information at 
segmental areas or picture elements. Further, each mea- each pixel, at the end of any iteration, is the combined 
sure is made with two pixels, i.e. picture elements, that 45 measure of all the reset ratio products that have so far 
are identical in size and in shape. The two pixels in an reported to that pixel. Thus the number of pixels affect- 
illustrated pairing, however, differ in a spatial parame- ing the reset ratio product can be equal to two raised to 
ter from other paired pixels. In one instance, the pixels the power of the number of iterations. If there are eigh- 
of one pair are of different size from the pixels of an- teen iterations, then the number of interactions is equal 
other pair. In another instance, one pair involves pixels 50 to two to the eighteenth power. By way of contrast, a 
separated by a distance different from the separation prior process brings to each pixel a reset ratio product 
between other paired pixels, and/or one pair involves carrying the information from a number of pixels equal 
pixels separated along a direction different from the to only the number of iterations, 
separation direction of other paired pixels. A mode of operation intermediate to the iterative 

Also in the embodiments below, each measure of the 55 replacing of reset ratio product measures and the pool- 
radiance information at the paired pixels is determined ing of such measures, is the averaging of reset ratio 
with a transition measure e.g. with the ratio of the radi- product measures from different sets of pairings. An- 
ance information associated with two paired pixels. other operating mode involves determining reset ratio 
This ratio is multiplied by a dimensionless value previ- product measures for a set of pixel pairings, and using 
ously assigned to or determined for one pixel of the pair, 60 the resultant measure in determining further measures 
i.e. for the divisor pixel of the ratio. The resultant prod- with a successive set of pixel pairings with a different 
uct is reset with reference to a selected limit The reset magnification of the image field, 
ratio product can serve as the desired comparison mea- These and other features of the invention are de- 
sure for a given pairing of pixels. scribed below with reference to different image-pro- 

However, in a preferred practice of the invention, the 65 ducing embodiments. One embodiment involves pairs 

reset ratio product is pooled by combining it with a of pixels of identical size and configuration. It employs 

dimensionless lightness-related value previously as- a sequence of pixel pairings ordered both with succes- 

signed to or determined for the other pixel of the pair. sively smaller pixel spacings and with different direc- 
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tions of pixel separation. The processing of radiance FIG. 2 is a vector pattern partially illustrating a pro- 
information in these embodiments preferably proceeds gression of spatial parameters for pairing pixels in ae- 
on a field-by-field basis. That is, the iterations for any cordance with one practice of the invention; 
one pixel or other segmental area of the image field FIG. 3 is a block schematic representation of an im- 
occur essentially in step with iterations for other pixels 5 age-producing system embodying features of the inven- 
of the field. The steps within each iteration can occur tion; 

either time sequentially or in parallel for the different FIG. 4 is a flow chart illustrating a practice of the 
pixels. Radiance information is compared in the field- invention with the system of FIG. 3; 
by-field basis by shifting a pattern of radiance informa- FIG. 5 shows five look up table functions for use in 
tion and comparing it to the unshifted pattern. The 10 the system of FIG. 3; 

shifting is illustrated both on a time basis, e.g. by use of FIGS. 6A, 6*B, 6C and 6D are schematic drawings of 
delay lines, and on a spatial basis, e.g. by the use of one image processor of the system of FIG. 3 illustrating 
known scroll techniques. successive operating stages; 

Other embodiments involve pairs of pixels that repre- FIGS. 7A, 7B, 7C and 7D are diagrammatic repre- 
sent areas of the image field different in size from those 15 sentations of a portion of an image processor of FIG. 3 
which other pairings represent The measurements of and illustrate one implementation of wraparound insula- 
radiance transition in either instance can proceed in tion in accordance with the invention; 
different sequences to attain replaced reset ratio prod- . FIG. 8 shows two look up table functions for the 
uct measures, to pool the measures from one iteration or practice of wraparound insulation as illustrated in 
set of iterations to the next, of to average the measures 20 FIGS. 7A-D; 

from independent sets of iterations. FIG. 9 is a block schematic diagram of another em- 

These and other image-producing features of the. bodiment of an image processor in accordance with the 
invention may have wide application. Specific instances invention; 

include photographic processing, e.g. in a camera as FIG. 10 is a diagrammatic representation of a map- 
well as in print making, and television signal processing, 25 ping of information in a memory for practice of features 
e.g. in broadcast equipment as well as in a receiver. of the invention; 

Other instances include devices, for example laser scan- FIG. 11 is a block schematic representation of an- 
ning devices, used in graphic arts to scan documents other image-producing system embodying features of 
and generate corresponding printing plates. In these the invention; and 

applications, as the above-described experiments illus- 30 FIG. 12 is a diagrammatic representation of a self- 
trate, the invention enhances the overall lightness qual- developing camera in accordance with the invention, 
ity of the displayed image. In addition, it corrects for a FIG. 13 shows a graph indicating the numeral trans- 
variety of visually detrimental factors including ttlumi- formation of stage 60. 
nation deficiencies and material and equipment limita- 
tions in reproducing wide bandwidth and intensity 35 DESCRIPTION OF ILLUSTRATED 
ranges. EMBODIMENTS 

Further applications of the invention can produce The processing of this invention determines a mea- 
displays in instances where a scene is examined non- sure of all transitions in the radiance associated with 
optically, and even where there is no original scene. each of different groups of areas or pixels in an image 
Examples of the former include the creation of an image 40 field. One practice involves groupings of two pixels, Le. 
display of an object examined with sonar techniques, pairs of pixels, and determines the desired measure as 
with infrared techniques, or with radar techniques. the product of(i) the ratio of the radiances at the paired 
Instances of the latter application include displays pro- pixels and (ii) an existing measure initially assigned to or 
duced with computerized axial tomography (CAT) previously determined for the pixel associated with the 
scanners and with other nuclear medicine instruments. 45 denominator of the ratio. Numbers proportional to log- 
All these applications of lightness imaging in accor- arithms of the relevant measures are typically em- 
dance with the invention can produce images that are ployed, so that an adder can perform the computations: 
consistently perceived as more satisfactory than those the log of the ratio is the sum of the log of one radiance 
heretofore available. Those skilled in the art will realize plus the negative log of the other radiance, and the log 
from these teachings that the practice of the invention 50 of the product is the sum of the log of the existing mea- 
can also produce images with all manner of specially sure and the log of the ratio. 

contrived lightness effects. The resultant ratio-product, also termed an interme- 

The invention accordingly comprises the several diate product, is referenced to a selected lightness con- 
steps and the relation of one or more of such steps with dition. A preferred practice is to reset each resultant 
respect to each of the others, and the apparatus em- 55 which exceeds the value equivalent to maximum image 
bodying features of construction, combinations of ele- lightness to that value. This reset operation establishes 
ments, and arrangements of parts adapted to effect such those specific locations or pixels in the scene which are 
steps, all as explained in the following detailed disclo- lightness reference points for subsequent operations, 
sure, and the scope of the invention is indicated in the The above-noted U.S. Pat. Nos. 3,553,360 and 3,651,252 
claims. 60 and the above-noted article of McCann, McKee and 

BRIEF DESCRIPTION OF DRAWINGS Taylor discuss prior practices regarding the foregoing 

ratio, product and reset operations. 
For a fuller understanding of the nature and objects The reset intermediate product determined with each 
of the invention, reference should be made to the fol- such measuring iteration can be used as the existing 
lowing detailed description and the accompanying 65 measure for the next iteration. However, the invention 
drawings, in which: attains a decrease in the number of iterations required to 

FIGS. 1A, lB, .lCand ID are diagrammatic illustra- produce a high quality image by averaging the reset 
tions of an information pooling feature of the invention; product with the existing measure at the pixel which is 
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associated with the numerator of the ratio for that pair. left to right represents a successive comparison-measur- 
The resultant averaged product is the transition desired ing iteration. The top row shows the same sixteen ar- 
measure for that pixel, as determined with that pair of rayed sections A, B, C ... O and X of an image field for 
pixels at this iterative stage in the sequence. This aver- each of the four iterations. The sixteen sections of the 
aged product also replaces the prior measure for that 5 field, or sixteen picture elements, i.e. pixels, are for 
pixel and is used in the next measuring iteration. This clarity shown, well spaced apart, but in actuality adja- 
averaging operation increases significantly the informa- cent ones are often contiguous or nearly contiguous, 
tion wtiich the resultant, averaged product contains, the middle row of FIG. 1 shows those pixels of the top 
because in each iteration information from nearly every row which, at the end of each iteration, have contrib- 
pixel contributes to two resultant products. 10 uted radiance information to a measure made with the 

The objective for lightness imaging in this way is to pixel (X). The lower row shows a vector representation 
determine a comparison measure for each pixel relative of the magnitude and direction of the spacing between 
to every other pixel, i.e. to compare the radiance of paired pixels. 

each pixel with that of every other pixel by subjecting ' The first illustrated iteration, FIG. 1A, shows the 
selected radiance ratios to the foregoing product, reset 15 aforesaid measure of radiance transition between each 
and averaging operations. In principle, there are many pixel and the pixel two locations to the left of it. Direct- 
practices of these comparison measuring operations that ing attention to pixel (X), the radiance there is com- 
can yield the desired lightness information for creating pared with the radiance of pixel (I). The specific com- 
a high quality image. However, in addition to using an putation forms the ratio of the radiance at pixel (X) to 
averaged product rather than simply the reset product 20 that at pixel (I) and multiplies the ratio by the existing 
as just discussed, the invention minimizes computation measure at pixel (J) to form an intermediate product 
by using multiple groupings of pixels, each with a spa- The intermediate product is reset and averaged with the 
tial parameter different from other groupings or at least existing measure at pixel (X). This computation yields 
other sets of groupings. One specific example is to use the desired averaged product at pixel (X). It is a func- 
pairs of pixels, each of which differs from other pairs in 25 tion of the radiances at pixels (X) and (I) and of the 
the spatial separation between the paired pixels, and/or previously existing products at these two pixels. The 
in the direction of the spacing between paired pixels. second row in FIG. 1A accordingly shows these two 
Another specific example is to compare with one pair- pixels. The third row designates with a single horizontal 
ing pixels different in size from those compared in other vector the direction from which pixel (X) received 
pairings. 30 radiance information. Simultaneous with these measur- 

Another feature of this invention is the realization ing steps, every other pixel (A) through (O) in the upper 
that an image can be broken down into multiple group- column of FIG. 1A receives radiance information from 
ings of pixels in a manner such that both local and the pixel two locations to the left of it, neglecting for the 
global interactions, e.g. comparative measures with moment pixels in the left half of the image field for there 
proximate locations and with remote locations, can be 35 are no pixels two locations to the left of them, 
calculated at an extremely rapid rate. Different segmen- FIG. IB illustrates that the next iteration measures a 
tal areas are compared so that long-distance spatial radiance transition between each pixel and the pixel two 
interactions can be computed in much less time than locations above it The radiance at pixel (X) is accord- 
with processes involving only contiguous pixels. By ingly compared with the radiance at pixel (C% and the 
transforming the image into a representation that con- 40 ratio is multiplied by the existing product determined 
tains comparatively few segmental areas, locations for pixel (C) in the first iteration. After resetting and 
which are separated by long distances in the original averaging with the existing product just determined for 
representation of the image are now comparatively pixel (X), the result is a new averaged product for pixel 
close. This strategy loses resolution, or introduces er- (X). 

rors, due to the coarseness of the analysis. Nevertheless, 45 This averaged product is a function of both the radi- 
this ability to perform long distance calculations in few ances at pixels (X) and (C), and the existing products, 
iterations yields enormous reductions in the number of i.e. averaged products, determined for each of these 
iterations and correspondingly in the processing time. locations in the first iteration. Hence the new averaged 
Further, the problems regarding resolution and charac- product assigned to pixel (X), after the second iteration, 
tcristic errors are overcome by a judicious choice of 50 is a function of the radiance information at pixels (X) f 
segmental areas in subsequent stages of the calculation. (I), (C) and (A). The middle row in FIG. IB depicts this 
A corollary feature is the provision for a subdivision of multiple feeding or contribution of radiance information 
the image into various segmental areas for separate to pixel (X). The third row of FIG. IB represents the 
calculations of various components of a lightness field, second iteration pairing as a vector whch starts from the 
followed by a recombination of the processed informa- 55 terminus of the first iteration vector. This cumulative 
tion into a lightness field that is influenced by each vector representation reflects the progressive accumu- 
characteristic set of segmental areas. lation of information at pixel (X), that is, the measure at 

Still another iteration-saving feature is to order the pixel (X) has a history from the prior iterations. Again, 
comparison-measuring iterations according to the mag- information for every other pixel in the illustrated six- 
nitude of the pixel spacings or other spatial parameter. 60 teen-pixel array is processed during the second iteration 
These features, together with others described hereinaf- in the same manner as just described for pixel (X). 
ter, arc remarkably effective in attaining a close approx- The third iteration, shown in FIG. 1C, pairs each 
imation to the foregoing objective on a real-time bask pixel with the pixel one location to the right: It hence 

FIG. 1 illustrates the effectiveness of the foregoing relates pixels (X) and (K). The existing measure at pixel 
features in inter-comparing various elements of an 65 (K) is an averaged product with a history of two itera- 
image field with a limited number of operating itera- tions and hence is a function of the radiances at pixels 
tions. FIG. 1 is arranged in four columns, i.e. FIGS. 1A, (J), (B) and (D). Accordingly, the new averaged prod- 
IB, 1C and ID, and in three rows. Each column from uct at pixel (X) is a function of the radiances at eight 
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pixels, as the second column in FIG. 1C depicts. The The process next uses a reset-pooling technique that 

vector representation of the pixel jump for this third calculates, for each pixel, a combined measure that is an 

iteration appears in the lower row of FIG. 1C. optimal lightness field value for that pixel. This resul- 

The illustrated fourth iteration pairs each pixel with tant can be attained by averaging each new reset ratio 
the one located one unit below it, FIG. ID. The infor- 5 product value with the previously assigned or deter- 
mation for pixel (X) is hence compared with that at mined value. Each ratio product value is reset before it 
pixel (N). The averaged product for each of these loca- is averaged with the previously determined value for 
tions has a different eight-pixel history, as FIG. 1C that pixel; the reset mechanism removes from the corn- 
shows in the middle row for pixel (X), developed over bined measure those ratio product values that are 
the three prior iterations. Consequently, the resultant 1° known to report lightness field values higher than the 
new averaged product at pixel (X) is a function of the particular imaging medium can display. The presence of 
initial radiances at each of the other fifteen pixels, as the tms severely non-linear resetting operation distin- 
simplified FIG. ID depicts in the second row. (The guishes this image processing from others that simply 
simplification in the second row of FIG. ID is that only compare radiances to average values computed over 
some prior interactions are shown.) The pairing vector 15 portions of the image or over the entire image, 
between pixel (N) and pixel (X) is added to the prior 1° addition to this reset-pooling technique, which 
vectors to yield the vector representation which ap- accumulates information in a learning-like manner, the 
pears in the lower row of FIG. ID. Note that successive ' processing incorporates the noted local-global calcula- 
vectors extend at right angles to one another. Note also tions that reduc e the total number of calculations to 
that successive vectors, from iteration one to four, are 20 S 2 " 11 the same information. Local-global computations 
either of the same or lesser size. m Purred to attain a satisfactory lightness field cal- 

In this manner, four relatively simple iterations com- culation which does not ignore any portion of the image 

pare the radiance at each pixel with that of fifteen oth- fle1 ^ The . or long-distance interactions provide 

ers. Expressed mathematically, the process is such that each Portion of the image with the correct relationship 

after (N) steps the radiance at each pixel is compared 25 f° dlstant ima _ fie * hoc ? infractions 

with those at (2*- 1) other pixels. important as well, because they provide high resolution 

FIG. 2 shows twelve steps of an actual eighteen-step '"^If 1 which reliably relates nearby points to each 

vector pattern with which the invention has been sue- 0thcr * ™ e ^ m P oslte technique just described pro- 

cessfully practiced with an image field having a » ^^^^f^^^^cimpai^ 

(512)X(512) array of pixels. For clarity of illustration, 30 ^^^k ^ mt ^onsAt 

FIG. 2 omits the two initial largest steps and the final P /°£f CS ^ en ^ e ,ma ^ "J* 

four smallest steps. The illustrated pattern involves an ^^^^^^ n and combines the results 

„ , . M M . . . . A with the reset-pooling technique. The process continues 

ordered progress.on of rterat.ons commencing with two in this ^^J^ f t exammes Ae £ with sm ]e 

successive steps of (256) pixels each (not shown m FIG. 35 j^, 8 

2), followed by the two steps shown of (128) pixels ^ processi iteration illustrated m mG t fcr . 

each, and proceeding as shown with two steps of sixty- ab , mvolves at least fonr sfe L rad product reset 

four p.xels each, two of thirty-two p.xels each two of md , _ ^ & fleW information like 

s.xteen pixels eacMwo of etght pixels each, and two of ^ field assodllileA ^ ^ (4)x(4) of ^ m 

four pixels each. These are followed by four steps not 40 FIG. 1. Each item of information in the field stems from 

shown:two of two pixels each and two of one pixel ^ radiance ^ a particular location, i.e. pixel, in the 

each. The spac.ngs between the pixels of successive two-dimensional image field and hence can be identified 

pairings thus progressively decrease m length. The by ^ ^ coordinates Q f that pixel, 

directions 0/ the spacings also progressively change, The flrst step of iteration k t0 ^ the ^ of 

e g successive directions in the illustrated pattern On- 45 the image field and to compute for each pair the ratio of 

eluding the six steps not shown in FIG. 2) are perperi- the radiance values at the paired pixels. The ratio is a 

dicular to one another in clockwise order. The eighteen mea sure which compares the radiance at one pixel, 

companson-measunng iterations with this ordered sue- termed a source pixel, to the radiance at the paired 

cession of pairing steps yield an averaged product for pixe l, termed a comparison pixel. When the radiance 

each pixel, aside from those which are to be compared 50 information is logarithmic the log of this ratio can be 

with locations beyond a boundary of the image field, calculated as the arithmetic difference between the logs 

which is the result of comparing the radiance there with 0 f the paired radiance values. Thus where r(o,o) repre- 

those at over a quarter-million other pixels. The final gents the radiance information at the origin pixel and 

averaged products can be used to produce a photo- r(x,y) represents the radiance value at the comparison 

graphic image having the significantly improved light- 55 pixel, the ratio operation which the first step performs 

ness qualities described in the foregoing examples. can be represented by the algebraic expression: 

The image processing described with reference to 

FIGS. 1 and 2 incorporates several features. One is that ^ v> {1) 

it uses field-by-field computations so that each iteration lo e ™lo) = lo s - lo e 

calculates a new measure for each pixel. The example in 60 

FIG. 1 explicitly describes the process that calculates The second step in the processing iteration is to multi- 
the measure for pixel (X). That process, however, is a ply this ratio by a product previously assigned to or 
one-pixel part of multi-pixel field-by-field computations determined for the origin pixel of each pair, to deter- 
that yield, at each iteration, a new resultant for each mine an intermediate product for the comparison pixel, 
pixel in the field. Further, each iteration after the first 65 The multiplication can be performed by the addition of 
one brings every pixel the information already accumu- logarithms of the numbers. Hence, the algebraic expres- 
lated by another pixel, thus producing a geometric sion for the log of the intermediate product at the com- 
growth of interactions. parison pixel is 
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the red, blue and green color bands as conventional in 
log ip(x.y)=)o8 op(M+lQg ^)-log dao) (2) full color electronic image processing. Each processor 

20, 22 and 24 processes the radiance-identifying signals 
where: t in a single color band to develop signals identifying the 

log ip<x,y) u the log of Ae intermediate product at 5 image lightness property for that ^ band at ^ 
the comparison pixel of the pair; and im m ^ j field ifl the f(eId of view of the 

log op(o ( o) is the log of the old product previously lens system 18 
existing, i.e old product, at the ori^n pixel. Qne cessor ^ m further detail> has a first 

The system is initialized for the Alteration by assign- refresh ^ channel * which has a refresh memory 
ing an old product to each pixel. The imtiahzing prod- 10 ^ u J. d , fc j 3 Jh * 

uct preferably corresponds to an extreme optical condi- 1°' 7 . ' , u F * . 

tion such as total blackness or full whiteness. The illus- "J™* « b , e a random . mcm ^ t0 si ™ 

trated embodiment initializes with the latter, which * e * cl ?J> f * fo ™fI"> n ^ ^,T^?!^;2£ 
corresponds to an initializing value of unity. illustrated input stage detector has a (512)X(512) CCD 

In each processing iteration the third step takes inter- 15 *™? ^ * e refresh memory has capacity to store the 
mediate products which are greater than unity and radiance information for each detector element as a byte 
resets tbem to unity. A star (*), designates a reset inter- of e, 6 ht blts - In a typical representation of signals, the 
mediate product in the following equations (3) and (4). maximum possible response is assigned to the level 255, 
The fourth processing step combines reset intermedi- om< %> response is assigned to the level 0, with 

ate products to form, for each comparison pixel, a new 20 logarithmic signal increments evenly assigned to the 
averaged product to be used in the next iteration. As levels between. The scroll device 30 can displace the 
described with reference to FIG. 1, it has been found field of image information from the refresh memory 
preferable to produce the new averaged product as the independently along both the (X) and the (Y) directions 
geometric mean of the existing or old averaged product by a number of specified coordinates. It typically em- 
at the comparison pixel in each pairing and the new ^ ploys a shift register and a memory to recall a sequence 
value of the reset intermediate product that pixel, of scroll positions. The look up table 32 employs a ran- 
formed as set forth in equation (2). Where the term "log dom access memory that is addressed by each informa- 
op(x,y)" is the logarithm of the old averaged product at tion byte being processed to provide a real time trans- 
the comparison pixel, the new product (np) at that loca- formation. The table 32 provides a negative transforma- 
tion is thus calculated as ^ tion function. The term "negative" denotes an arithme- 
tic function having a slope of (—1). The effect of pro- 
log n^)-Pog otfx,y)+io& ip*(x.y)]/2 (3) cessing a field of image information with such a polarity 

inverting function is to convert between a positive 
and is defined as image and a negative image. 

, . . -r„ . v, « . . . i< The FIG. 3 system has a second refresh channel 34 

KaSf-f (4) ^ a refresh memor y 3 * a scro11 device 38 > and a look 

up table 40. A third refresh channel 42 has a refresh 
This log of the new averaged product at the comparison memory 44 and a look up table 46, but requires no scroll 
location (x,y) is used as the log of the old product term device. An adder 48 is connected with the look up 
for that location in the next iteration. 40 32 » 4°« 46 from *** of ^ three channels 26, 34 

The invention can be practiced without the fourth ™ d 42 - lt sums active "P"* a PP lies the resul- 
processing step. That practice uses the reset intermedi- tant to an adder output line 50. A feedback connection 
ate product as the comparison measure assigned to the 52 applies the output from the adder, by way of a look 
comparison pixel for the next iteration. The preferred up table 54, selectively to the input of the second chan- 
practice, however, includes the fourth step, which im- 45 nel memory 36 and third channel memory 44. 
proves both the efficiency of the process and the quality ^ s^em output stages are illustrated as a nonlinear 
of the results. color masking stage 58, an exposure control stage 60, 

and a display stage 62. A program control unit 56, typi- 
An Image Producing System including a programmable processor and con- 

FIG. 3 shows a full-color image-producing system 50 nected with each processor 20, 22 and 24 and with each 
which implements the foregoing lightness-imaging stage 58, 60 and 62 as illustrated, controls the system 
techniques. The system has an input stage 12 that devel- operation. The color masking stage 58 provides a color 
ops information identifying the optical radiance of a masking operation which accentuates the color of each 
field of view to be displayed. The illustrated input stage area of the image field and compensates for color desat- 
is a camera, e.g. photographic or television, and has an 55 uration both in the input stage detector 14 and in the 
optical detector 14 that receives the light energy from a display stage 62. By way of example, a general purpose 
field of view or other original image 16 via a lens system of color masking in photography is to correct for differ- 
18. The detector 14 is typically a multi-element array of ences between ideal dyes and dyes realizable in actual 
photosensitive elements, each of which produces an photographic systems. The literature regarding such 
electrical signal in response to the light energy incident 60 color masking includes: Clulow, F. W., Color Its Princi- 
on it. The detector response preferably is proportional pies And Applications, published by Morgan & Morgan 
to the logarithm of the light energy to facilitate subse- in New York, 1972, pages 157-159 and 172-179; and 
quent signal processing. Examples of such a detector Hunt, R. W. G., The Reproduction Of Colon published 
are an array of charge coupled devices, Le. a CCD by Wiley in London, 1967, pages 233-263 and 383-416. 
array, or a charge induction (CID) array. 65 The color mask stage 58 can also correct for the limited 

The input stage 12 thus applies electrical signals pro- color response and limited color transmission capabili- 
portional to the logarithm of radiance to each of three ties in the various stages and elements of the system, 
identical image processors 20, 22 and 24, one for each of The color mask stage 58 thus typically provides color 
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correction, color enhancement and color masking to 
optimize the output signals from the image processors 
20, 22 and 24 for subsequent color display. It can also 
provide an antilog conversion function unless that func- 
tion has been provided in adder 48. 

The exposure control stage 60 transforms the pro- 
cessed and color masked lightness-identifying signals 
into the format which matches the display stage 62. In a 
television-imaging system, the display element 62 typi- 
cally includes a cathode ray tube television display such 
as a video monitor, whereas in a photographic camera 
system this element typically includes a light-emitting 
diode (LED) array arranged to expose photographic 
film. 

The foregoing elements of the FIG. 3 system can be 
conventional devices known to those skilled in the art, 
including the arts of computer graphics, electronic 
image processors, and image computers. By way of 
example, the International Imaging Systems division of 



10 



15 



44 store can have any of (256) possible values. The FIG. 
5 functions hence show the new values which the differ- 
ent look up functions assign to each of the possible (256) 
values, and to the possible values which the sum of two 
bytes can have. 

FIGS. 4 and 6A show that the aforementioned first- 
step operation of pairing pixels is carried out by scroll- 
ing the contents of the first channel refresh memory 28 
with the scroll device 30. The scroll, which can be of 
any magnitude in either or both directions, is designated 
as being of (x„, y n ) pixels. The subscript (n) identifies the 
number of the iteration being performed, inasmuch as 
different iterations in an operating cycle can — and gen- 
erally do — involve different scroll steps. The first illus- 
trated step of the eighteen-iteration operating cycle 
which FIG. 2 in part shows involves, by way of exam- 
ple, a scroll of (128, 0) at this juncture. Where pertinent, 
FIGS. 4 and 6 show the block representation of each 
refresh memory with a coordinate designation in the 



Stanford Technology Corporation markets an image 20 upper right comer to indicate whether the contents 



computer which employs elements suitable for the im- 
age-producing system of FIG. 3. 

System Operation 

FIG. 4 is a flow chart of the foregoing four step 25 
iteration applied to the FIG. 3 processor 20. This pro- 
cessor is typical of the other processors 22 and 24, for 
the three image processors can be identical in construc- 
tion and in operation, and operate independently of one 



correspond to the origin pixel or to the comparison 
pixel of a pairing. FIG. 6A accordingly shows the re- 
fresh memory 28 with the origin-designating coordi- 
nates (o,o). 

FIG. 6A also shows that the data path which the 
program control unit 56 (FIG. 3) establishes in the pro- 
cessor 20 for this scroll operation applies the contents of 
the first channel refresh memory 28 to the scroll device 
30, which introduces the specified scroll. The scrolled 



another except as the program control unit 56 imposes 30 image information is applied to the look up table 32, 



simultaneous or other time-coordinated operation. The 
three refresh memories 28, 36 and 44 of the processor 20 
are assigned different rows of the flow chart, and suc- 
cessive operations are shown at different positions along 
the chart starting with the initial conditions at the left 35 
and progressing to the right. The processor is initialized 
by storing original image radiance information received 
from the input stage 12 in the first channel refresh mem- 
ory 28. The initial contents of the second channel mem- 



which transfers it without change to the adder 48. The 
adder has no other active inputs and hence simply ap- 
plies the same scrolled image information to the feed- 
back look up table 54. This element applies the linear 
and reset function of FIG. 5E, which in this instance 
imparts no transformation to the data, so that the 
scrolled image information output from the scroll de- 
vice 30 is applied to the refresh memory 36 of the sec- 
ond channel 34. The memory stores this information 



ory 36 are not significant. The third channel memory 44 40 with an operation subsequent to FIG. 6A. 



is initialized with reset ratio product values correspond- 
ing to 100% reflectance, as discussed above. 

The flow chart of FIG. 4 is described further to- 
gether with FIGS. 6A, 6B, 6C and 6D, which show the 
image processor 20 at different stages in the four-step 45 
iteration. The several FIG. 6 drawings are thus identical 
except that each shows different specific connections 
which the program control unit 56 provides between 
the elements of the processor. Further, each FIG. 6 
illustration shows with a heavy line the path of informa- 
tion transfer between the processor elements for a spe- 
cific step in the operating sequence. 

The FIG. 6 drawings also designate the functions 
which each illustrated look up table 32, 40, 46 and 54 
can provide, and FIG. 5 shows a graphical representa- 
tion of each function. With particular reference to FIG. 
6A, the look up table 32 can provide either no transfor- 
mation or the negative function of FIG. 5A. The look 
up table 40 in the second refresh channel can provide 



50 



55 



FIG. 4 designates the foregoing scroll and store oper- 
ations in the first portion of Step I. At this juncture, the 
radiance information for each pixel of the original 
image is paired with the radiance information of the 
pixel offset from it by x n and y„ pixels. 

The illustrated image processor 20 executes the re- 
maining first-step operation of computing the ratios of 
paired radiance values by applying both the negative 
contents of the first channel memory 28 and the con- 
tents of the second channel memory 36 to the adder 48, 
and by storing the resultant sum from the adder in the 
memory 36. FIG. 4 designates these operations in the 
last portion of Step I. FIG. 6B shows that to provide 
this operation the program control unit 56 applies the 
contents of the first channel memory 28 through the 
scroll device 30, which imparts no scroll, and actuates 
the look up table 32 to provide the negative function 
and apply the transformed data to the adder 48. The 
control unit also applies the scrolled image information 



either no transformation, an expand to nine-bit function 60 in the second channel memory 36 through the scrolled 



of FIG. 5C, or a compress to seven-bit function of FIG. 
5B. The feedback look up table 54 likewise can provide 
any of three functions, i.e. no transformation, a com- 
press to eight-bit function of FIG. 5D, or a linear and 
reset function of FIG. 5E. 

Each look up table 32, 40, 46 and 54 thus can assign 
new values to each byte applied to it. The eight-bit 
bytes which the illustrated refresh memories 28, 36 and 



65 



device 38, again without scroll, and through the look up 
table 40 without transformation to a second input of the 
adder 48. 

The adder sums the two binary input signals and 
applies the resultant nine-bit byte to the feedback look 
up table 54, which the control unit 56 actuates to pro- 
vide the compress to eight-bit function (FIG. 5D). This 
function changes the nine-bit byte output from the 
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adder 48 to an eight-bit representation. The purpose is scrolled by (x) and (y) units from the initial coordinates, 

merely to accommodate a memory 36 which has only as a result of the scroll operation performed in Step I, 

an eight-bit byte capacity. (Note that each FIG. 6 draw- whereas the contents of the latter memory are at the 

ing shows the contents of the refresh memories 28 and initial coordinates designated (o, o). The reset product 

36 and 44 at the beginning of the operation which it 5 contents of the refresh memory 36 accordingly are 

depicts. Thus, FIG. 6A shows the contents of the re- scrolled back to the initial coordinates with the scroll 

fresh memories at the beginning of the scroll operation, device 38 by the requisite ( — x a ) and ( - y«) coordinates, 

and FIG. 6B shows the memory contents at the begin- as FIG. 6D shows, before being applied to the adder 48. 

ning of the ratio-computing operation.) With further reference to FIG. 6D, the second chan- 

To execute the second step of an iteration, which 10 nel look up table 40 compresses the reset products to 
forms the product of the ratio with a quantity desig- seven-bit bytes with the function of FIG. 5B. The third 
nated an old product and which may be existing or channel look up table 46 imparts a similar compress 
assigned, the program control unit 56 conditions the function to the old product contents of the refresh mem- 
channel two and channel three elements to sum the ory 44. The resultant two sets of numbers are applied to 
contents of the refresh memories 36 and 44, as FIG. 6C 15 the adder 48. The compress operations imposed by the 
shows. The resultant intermediate product is stored in look up tables 40 and 46 yield from the adder 48 an 
the refresh memory 36, all as the flow chart of FIG. 4 eight-bit sum which can be stored directly within the 
designates for Step II and in accordance with Equation eight-bit capacity of the refresh memory 44. 
(2). More particularly, with reference to FIG. 6C t the More importantly, by compressing each set of num- 
ratio information in the refresh memory 36 is applied 20 bers from the memories 36 and 44 in this manner prior 
through the scroll device 38, without offset, to the ex- to the addition, the resultant sum from the adder repre- 
pand function of the look up table 40. This transforma- sents an equal weighted, i.e. fifty-fifty, average of the 
tion expands the eight-bit representation of each num- two . sets of numbers. Where unequal weightings are 
ber to a nine-bit byte, FIG. 5C. This expand operation desired for the averaging, the look up tables 40 and 46 
restores to the information read from the refresh mem- 25 can have appropriate compressing functions to yield a 
ory 36 the nine-bit format it had prior to the compress to sum which is the appropriately weighted average. A 
eight-bit function which the feedback look up table 54 further reason for the compress to seven-bit operation 
imposed during the prior, ratio computing, step. The prior to addition is described hereinafter, 
nine-bit output from the look up table 40 is applied to FIG. 6D also shows that the feedback look up table 
the adder 48, as are the contents of the third channel 30 54 applies the linear the reset function (FIG. 5E) to the 
refresh memory 44. For the first iteration of operation, resultant sum from the adder 48, and that the output 
this memory stores an initialized old product for each from the table is applied to the third channel refresh 
pixel, preferably corresponding to a uniform field of memory 44. The numbers input to the look up table 54 
100% reflectance as previously discussed. The adder 48 are all within the (0) to (255) range, and accordingly the 
sums the two inputs to develop the intermediate prod- 35 table applies the linear portion of its function to the sum, 
uct. i.e., applies the sum from the adder to the memory 44 

The feedback look up table 54 performs the Step III without transformation, 

reset operation on the intermediate product from the FIG. 4 shows the resultant averaged new product in 

adder 48 as FIG. 6C shows. The reset intermediate the refresh memory 44 at the completion of this Step IV 

product is applied to the second channel refresh mem- 40 operation in terms of equation (4). 

ory 36. Each byte input to the table 54 is a sum from the The FIG. 3 image processor 20 is now ready to repeat 

adder 48, and the reset portion of the FIG. 5E function the four-step iteration. Each iteration after the first one 

is effective at this juncture. This function transforms uses the same original image field of radiance informa- 

input numbers valued between (-255) and (0) to (0), tipn which the first channel refresh memory 28 initially 

transforms input numbers with a value between (0) and 45 stored. However, the succeeding iterations do not use 

(255) to an eight-bit number of identical value, and the initialized conditions in the third channel refresh 

transforms input numbers with a value greater than memory 44, but rather use the new averaged product as 

(255) to the maximum value of (255). This reset function computed and stored in that memory in the last step of 

thus produces a field of eight-bit reset products which the preceding iteration. 

are limited to values between (0) and (255), and in 50 The FIG. 3 system performs a number of the itera- 
which input values both lower and greater than this tions described with reference to FIGS. 3-6 and corn- 
range are effectively clipped. Prior to this reset opera- pares different pixels in each iteration. The comparisons 
tion, each intermediate product identifies at least in part are made by scrolling the contents of the refresh mem o- 
a lightness value. The reset operation normalizes the ries 28 and 36 with the scroll devices 30 and 38 through 
values of the highest lightnesses in the image being 55 different coordinate distances in each iteration. The 
produced, regardless of the radiance detected or sensed theoretical objective is to compare the original image 
from that pixel in the original scene. radiance information, stored in the first channel mem- 

The reset intermediate products output from the feed- ory 28, for each pixel with that stored for every other 

back look up table 54 are stored in the second channel pixel. FIG. 2 shows a sub-set of twelve scroll displace- 

refresh memory 36 at the end of the Step III operation, 60 ments. It is a measure of the significance of the inven- 

as appears in FIG. 6D, which shows the condition of tion that a complete image-producing cycle requires 

the memory 36 prior to the next operation. only eighteen such iterations. The operation com- 

This next operation is the iteration Step IV determi- mences with a largest displacement, and proceeds 

nation of a new average product for each pixel. The two through the cycle with successive sets of two iterations, 

sets of logarithmic numbers to be combined for forming 65 each of which involves progressively smaller scroll 

the new product are in the second channel refresh mem- displacements. Note that in every iteration except the 

ory 36 and in the third channel refresh memory 44. final two, (i.e. numbers seventeen and eighteen), each 

However, the set of numbers in the former memory is pixel is paired for comparison with a pixel spaced from 
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it by more than one pixel unit. That is; all but the final images to reduce the influence of gradients on the dy- 

two pairings are between pixels that are separated with namic range of calculated lightness fields, 

at least one pixel between them. The array of averaged One mechanism alternative to a threshold for gradi- 

new products available from each processor 20, 22 and ent removal is a system that combines a reset step with 

24 at the completion of these eighteen iterations is ap- 5 a lightness field-determining operation in which many 

plied, under control of the program control unit 56, to different comparison segmental areas influence each 

the output stages 58, 60 and 62. This completes one segmental area. Each segmental area has a different 

operating cycle of the FIG. 3 system. history of spatial interactions with other areas. When 

the history of interactions is limited, the influence of 

Inresnold j 0 ram j om fluctuations is propagated along these limited 

With further reference to FIG. 3, where it is desired directions and causes local areas of unwarranted higher 

to impose a threshold on the ratio of radiances deter- or lower lightness. This unwanted propagation of ran- 

mined in each processing iteration, the feedback look up dom fluctuations does not occur when each segmental 

table 54 can provide this operation. The inset in FIG. area ^ influenced by very large numbers of comparison 

5D shows a compress to eight-bit function which also 15 segmental areas. Instead, the random events cancel one 

provides a threshold function. This illustrated threshold another. 

function is such that all input values between (—2) units Jn addi tion, a gradient is by definition a radiance 

and (-f 2) units inclusive produce the same output value. change in a particular direction. The combination mea- 

Such a threshold function can be advantageous in an sure whicn t™* invention provides does not emphasize 

image processor according to the invention to yield a 20 fiance gradients. The contributions of such gradients 

ratio of unity when the two radiance values being com- m different in magnitude for each direction and spatial 

pared are within a specified percent of each other. This parameter of comparison. Further, a gradient produces 

threshold removes the spatially slow changing effects of a s . maller change in lightness field calculations than an 

gradients of illumination found in many images. As object edge of the same magnitude. An extended edge is 

desired, a suitable threshold does not visibly affect the 25 equa ?l y de,ectable m aI1 directions that cross it It is 

accurate imaging of discontinuous changes in radiance ****** the combination measure may empha- 

information. The latter radiance changes or transitions, slze radl ^. cnan « es duced bv ."J*™!* ed 6 es be " 

which are the ones measured with the practice of this 031180 . most direct,ons and most parameters for 

invention, generally stem from the changes in reflec- 7n S^P^S s *?™™* ] ^ for comparison y ,eld the same 

tance that occur at the boundaries or edge of an object 30 me3SUre °f ^ ^ Hence multiple measuring itera- 

intheoriginalsceneorimage.By way of specific exam- K^Sta * 

£n,^^ (0) to (255) evenly repre- ,„ ^ ^ of ' human one fmdg 

sent four log units of radiance, the foregoing threshold 4 %. j- • * r * r • « • 

wi * ♦ -i- i *!.* literature the division of segments of visual images into 

stably treats radiance values that arc wjthin seven 35 ^ & jects , and fllulnin ation. In 

r^cen (7%) of each other as bemg equal. Tms .value is the literature contains numerous discussions of 

not critical; other values can be used as appropriate for how human ^ discounts illumination( „ that infor . 

the.mplementat.on and the appl.cat.on. matio „ about objects jn the f]eW of ^ ^ ^ 

r 1 £ ° ld « Pera o t 0n a P^ to1ile rat '° out P« t emphasis. This arbitrary division of visual images has 

from the adder 48 m Step I of the iteration described 40 many exceptions. For example, shadows produce large 

above. That K , the feedback look up table 54 imposes changes in sensation> despite the fact that they are inten- 

the threshold function simultaneous with the compress ^ variations in illumination. As another example, 

to eight-bit operation discussed with reference to FIG. gradual reflectance changes across the surface of an 

6B. It will be appreciated that a threshold is to some object smaH changes in sensation, despite the fact 

extent inherent as a result of quantifying data in the 45 that they rep resent changes in the properties of the 

present embodiment of the invention. The practice of object. 

the invention as described with the system of FIG. 3 i^ad of characterizing different portions of images 
hence can be considered as imposing a threshold on ^ ^ ^ illumination, it is more useful to char- 
each raUo computation. acterize them as radiance transitions that are abrupt, or 
A further finding of this invention is that a threshold 50 as radiance changes that are gradual. Radiance transi- 
alone is insufficient to remove from all images the unde- t ions that are abrupt generate large changes in lightness, 
suable effects on total dynamic range of gradual whereas radiance transitions that are gradual generate 
changes in illumination. When a uniformly illuminated small changes in lightness. Signal processing systems 
image has pixel-to-pixel variations in radiance which that produce lightness fields produce quantities that 
regularly exceed the threshold, the threshold alone is 55 correspond to lightness. 

not sufficient to remove gradients superimposed on that The foregoing lightness image processing of this in- 
image. The problem is typically encountered in images vention realizes these properties of visual processing by 
with significant pixel-to-pixel signal fluctuations which calculating combination measures in such a way that 
are introduced by limitations of the image detecting abrupt changes in radiance are characterized by a set of 
mechanism. Within a single image object, these varia- 60 reports all of which are the same. Furthermore, condi- 
tions commonly exceed the thresholds of plus or minus nation measures are calculated in such a way that gradi- 
one or two grey levels which typically are adequate in cnts are de-emphasized by either a threshold or a tech- 
fluctuation-free images. This degree of consistency ex- nique using many comparison segmental areas with 
ceeds the tolerance levels of typical electronic image different spatial interaction histories, or both, 
systems. Even with low-fluctuation images, a predomi- 65 

nance of minute object detail can have similar effects. Wraparound Insulation 
Despite the already demonstrated abilities of a thresh- Each image processor 20, 22 and 24 of FIG. 3 pro- 
old process, other techniques are important for many vides the foregoing measure of a radiance transition in a 
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manner different from that previously described in the The processor 20 which the invention provides 
case of a pixel that is paired with a location that lies . solves this problem by disregarding transition measures 
beyond a boundary of the image field; This different which result from such wraparound ratios. The proces- 
operation, termed wraparound insulation, minimizes sor instead identifies each pixel where the radiance 
errors that otherwise can arise from the foregoing de- 5 information is compared with information that is 
termination of a radiance transition measure, e.g. a new scrolled from edge to edge, i.e. where a wraparound 
product, for a pixel located such that after the scroll ratio is involved. The processor retains the old product 
displacement it is to be compared with an out-of-field for each such identified pixel and uses that product in 
location, i.e. a location that lies beyond a boundary of the next iteration, instead of determining a new product, 
the image field being processed. 10 as occurs for all other pixels. The processor 20, typical 

The image processor which the invention provides of the processors 22 and 24, thereby insulates each itera- 
avoids this error by identifying, in each iteration, each tion from communication between image locations that 
pixel that is to be compared with an out-of-field loca- are separated in a direction opposite to the direction of 
tion. The processor retains the old product for that the scroll for that iteration. 

pixel, and uses it as the new product This feature of the 15 FIG. 7B shows the same portions of the processor 20, 
invention is described with reference to an illustrative with the mapped contents of memories 28 and 36, as 
iteration diagrammed in FIGS. 7A, 7B, 7C and 7D for FIG. 7A. The mapping 66 at the right of FIG. 7B de- 
the image processor 20 and which involves pairing each picts the logarithm of a ratio and hence depicts the sum 
pixel with the one located (128) pixel units to the left. of the negative of the memory 28 contents and the mem- 
Each FIG. 7 drawing shows only a portion of the pro- 20 ory 36 contents output from the adder 48 after the Step 
cesser 20, and each designates the contents of each I ratio computation of Equation (1). The right-most 
illustrated refresh memory as mapped in four equal mapping region 664 contains the sum designated 
sized regions, each of (128) pixels by (512) pixels. The (A-D), wnich is a wraparound ratio, i.e. a difference 
original image information which memory 28 stores in between memory contents which in the first channel 
the memory regions 28a 28b. 28c and 28d is designated 25 memory 28 are separated in the direction opposite to the 
as A, B, C and D, respectively. direction of the scroll that preceded the ratio computa- 

The illustrated image processor 20 handles the out-of* tion. This sum manifests the wraparound error dis- 
field situation which the scroll of (128) units presents in cussed above. The contents of the remaining mapping 
a conventional manner. As FIG. 7A shows, the proces- regions 66a, 66b and 66c are correct and unaffected by 
sor scrolls the information A, which is originally stored 30 the scroll wraparound. 

in the leftmost region 28a of the first channel memory, The illustrated processor proceeds in the same man- 
to the opposite side and places it into the right edge ner described with reference to FIG. 6C with the Step 
region 36a* of the memory 36 in the second channel II computation of an intermediate product FIG. 7C 

FIG. 7A, which thus corresponds to FIG. 6A, fur- shows the mapping of the refresh memory contents for 
ther illustrates this wraparound scroll operation with 35 the second and third channels of the processor 20. The 
the representation that the contents of the refresh mem- contents of the memory 36 have the same mapping as 
ory 28, upon being scrolled (128) pixel units to the left, appears in the mapping 66 at the right side of FIG. 7B. 
have the format which appears in the memory map 64 The refresh memory 44 contains old product informa- 
shown to the right of the adder 48. This mapping of tion designated as FA, PB, PC, and PD for the four 
information is stored in the second channel refresh 40 memory regions 44a 44b, 44c and 44d, respectively, 
memory 36 by way of the feedback path 52. FIG. 7A The mapping 68 of the sum of these two memory con- 
thus shows the contents of the two refresh memories 28 tents with the adder 48 appears at the right side of FIG. 
and 36 after the Step I scroll operation. The shading 7C. This sum is the intermediate product computed 
designates the memory regions 28a and 36d which store according to Equation (2). The sums mapped in regions 
information that the scroll operation wraps around from 45 68a 68b and 68c are m the desired form, unaffected by 
one memory border to the other, i.e. the memory region the scroll wraparound. The sum mapped in region 684 
which in this example stores the information A. Thus, in however, is prone to scroll wraparound error, 
every iteration described above with reference to The processor operation proceeds to the Step III 
FIGS. 4 and 6, the image processor 20 scrolls the con- reset operation which the feedback look up table 54 
tents of memory elements adjacent an edge or boundary 50 performs, as described above with reference to FIG. 
of the memory and wraps it around for storage in mem- 6D. The reset intermediate product is stored in the 
ory elements adjacent the opposite edge or boundary. second channel refresh memory 36, as FIG. 7D shows. 

The transition-measuring image processing described To execute the last iteration step, i.e. the Step IV 
above with reference to FIG. 6, however, can encoun- averaging computation, the scroll device 38 scrolls the 
ter problems if it processes the wraparound information 55 contents of the second channel memory 36 by an equal 
in the same manner as other information. That is, imag- and opposite amount from the scroll effected in the first 
ing errors are likely to arise in the present example if the step of FIG. 7A, i.e. a scroll of (128) pixels to the right 
radiance information A wrapped around for storage in in this example. The mapping 70 in FIG. 7D represents 
region 36d of memory 36 is processed in the same man- the second channel refresh memory 36 contents after 
ner as the information in the other regions 36a 366 and 60 this scroll operation. The field of information is applied 
36c of that refresh memory. An example of this error to the adder 48 by way of the look up table 40. At the 
occurs where the original image being processed is of a same time, the contents of the channel three memory 44, 
scene illuminated from the right side with ten times shown in mapping 72 juxtaposed with mapping 70, are 
more light than on the left side. The 10-to-l gradient in applied to the adder 48 by way of the look up table 46. 
illumination improperly dominates the Step I ratio cal- 65 The illustrated processor 20 combines the two sets or 
culations where radiance information from pixels at fields of information in a straightforward manner for all 
opposite sides of the image field are compared by virtue regions of the mappings except for the region that in- 
of the scroll wraparound. eludes information manifesting scroll wraparound. This 
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is the information in the channel two memory region unmarked information. More particularly, each marked 

36d and which the scroll device 38 scrolled to the byte is an odd-valued number because it has a binary 

mapping region 70cr. ONE in the lowest order bit plane, whereas every un- 

The processor 20 develops the new product informa- marked byte has a binary ZERO in the low order bit 

tion for this region in response entirely to the old prod- 5 and hence' is valued as an even number. FIGS. 8A and 

uct information in the mapping region 12a> i.e; in the 8B designate the transfer function for each odd-valued 

region 44a of the third channel memory 44. As FIG. 7D input with a cross, and a circle designates the function 

shows, the resultant mapping 74 of the adder 48 output for each even-valued input. 

contains old product information in the region 74a. This The FIG. 8A transfer function produces a zerovalued 
mapping region corresponds identically to the memory 10 output in response to every odd-valued input, and pro- 
28 region 28a designated in FIG. 7 A as containing infor- duces a seven-bit output valued at one-half the magni- 
mation which this iteration would subject to a scroll tude of each even-valued input That is, an input byte of 
wrapround. The remaining mapping regions 74*, 74c decimal value 1, 3, 5, 7 ... 255 produces an output byte 
and 74a* contain new products computed as described of value zero, whereas an input byte of decimal value 
above according to Equation (4). The modified new 15 (8), for example, produces an output value of decimal 
product which the mapping 74 represents is stored in (4). With this transfer function of FIG. 8A, the look-up 
the channel three refresh memory 44, in accordance table 40 in the second refresh channel applies a zero- 
with the flow chart of FIG. 4, Step IV. valued input to the adder 48 in response to each marked 
One detailed operating sequence for determining a byte, which is a byte involved in a scroll wraparound, 
new product which retains old product information in 20 and applies a one-half value byte to the adder in re- 
the foregoing manner, as mapped in the memory region sponse to every unmarked input byte. 
74a, is to save the old product information in a buffer or The look up table of FIG. 8B likewise produces a 
other store of the program control unit 56, FIG. 3, prior one-half valued output for every even valued input 
to the product-producing addition operation of Step IV. byte. However, it responds to each odd-valued input 
A subsequent operation writes the saved old product 25 byte to produce an output value of the same magnitude, 
information into the specified region of the third chan- With this transfer function, the look up table 46 re- 
nd refresh memory 44. The program control unit 56 sponds to each unmarked input byte to apply a byte of 
can identify the region of memory 44 which contains one-half the input value to the adder 48, but responds to 
old product information to be saved in this manner by each marked input byte to apply a byte of the same 
using the coordinate displacement information, i.e. (x„, 30 value to the adder 48. 

y„), which controls the scroll devices 30 and 38 for the The adder 48 responds to the fields of intermediate 

iteration in process. product and old products transformed with these func- 

Another operating sequence for effecting the forego- tions to produce the desired "insulated" field of new 

ing wraparound insulation involves inserting a marker products which FIG. 7D shows with the mapping 74. 
digit in each refresh memory location which stores 35 

information that is to be subjected to a scroll wrap- A Two Cn*™* Ima S e Processor 

around. The look up tables 40 and 46 can effect a com- Before considering a further embodiment of the in- 

press function, with the sets of marked information, vention, note that the image processor 20 described 

different from that of FIG. 5B to yield from the adder with reference to FIGS. 6 and 7 employs three refresh 

48 an averaging in which the resultant for the marked 40 channels. The first stores original radiance information 

memory locations is responsive exclusively to the old regarding the image being processed. The second chan- 

product information. More particularly, according to nel is used to perform calculations in accordance with 

this alternative sequence, after the reset intermediate the lightness imaging process summarized in the flow 

product is stored in the second channel memory 36 to chart of FIG. 4. The third channel stores new product 

complete Step HI (FIGS. 3 and 7D), the program con- 45 information and presents it as old product information 

trol unit 56 clears the low order bit • of every byte of for the next iteration. In contrast to these features, FIG. 

product information in both refresh memories 36 and 9 shows another image processor 80 in accordance with 

44. The control unit next writes a binary ONE into the the invention. The processor 80 attains the same results 

low order bit of only those bytes which the register of as the processor 20, but with two memory channels, 

the scroll device 38 identifies as being involved in a 50 Further, it uses delay lines to effect scrolling in a time 

scroll wraparound for that iteration. This selective stor- domain, in contrast to scrolling in a spatial domain as in 

ing of binary ONES tags or marks each byte of product the processor 20. 

information in the memories 36 and 44 to identify those More particularly, the signal processor 80 has a first 

which reflect scroll wraparound. The marked contents refresh channel 82 with a refresh memory 84 that re- 

of the memory 36 are next scrolled in the usual manner 55 ceives information from an input stage 86. The contents 

with the scroll device 38. of the memory 84 can be applied to different inputs of 

However, instead of using the equal-weighting com- an array adder 88 by way of either a negative look up 

press function of FIG. 5B as discussed above with refer- table 90 or a delay line 92. A second refresh channel 94 

ence to FIG. 6D f the second channel look up table 40 of the processor 80 has a memory 96 connected to apply 

provides a selective-averaging transfer function shown 60 the contents to a further input of the adder 88 or to a 

in FIG. 8A, and the third channel look up table 46 second adder 100 by way of a further delay line 98. A 

provides a selective-averaging transfer function shown reset look up table 102 is connected to receive the out- 

in FIG. 8B. FIGS. 8A and 8B show each transfer func- put from the first adder 88 and apply it to the second 

tion for inputs of decimal magnitude (0) to (10); each adder 100. The output from the adder 100 is applied to 

function ranges in the same manner shown for inputs of 65 a look up table 104 having a compress to eight-bit func- 

magnitude (0) to (255). tion as shown in FIG. 5D. The output of the look up 

Each selective-averaging transfer function processes table 104 is the output from the processor 80. A feed- 

a byte of marked information differently from a byte of back path 106 applied this output to the input of the 



01/13/2004, EAST Version: 1.4.1 



4,384*336 

27 28 

second channel memory 94. The processor 80 operates This use of the buffer 110 provides wraparound insula- 

in conjunction with a program control unit 10$. tion in the manner described above with reference to 

The operation of the FIG. 9 processor 80 typically PIGS. 7A through 7D. 
commences in the same manner as described for the Three image processors identical to the processor 80 
processor 20 with the first channel memory 84 storing ;a. 5... of FIG. 9 can provide a full-color image producing 
field of original image information proportional to the, system like the system of FIG. 3. That is, the system of 
logarithm of the radiance at each element of the image FIG. 3 can be constructed with a two-channel proces- 
field. The second channel memory 96 is initialized with sor 80 (FIG. 9) in place of each processor 20, 22 and 24. 
the logarithm of a selected uniform radiance field. The It will also be apparent that the invention can provide 
processor 80 reads information from the refresh memo- 10 black-and-white and other single color imaging with a 
ries on a time sequential basis characteristic of conven- system as shown in FIG. 3 which has only a single 
tional shift register systems, With such operation, time image processor, instead of three as shown. Further, a 
after onset of a memory scan or read operation is di- single-processor system can calculate all three lightness 
recti y related to pixel location in the image field being fields for full color imaging with a time-sharing opera- 
processed. That is, the information for successive pixels 15 tion, i.e. by processing the red, the green, and the blue 
is read out at known successive times in a memory read components separately on a time sequential basis, 
operation. Further, each memory 84 and 96 can ad van- . . 
tageously use two orthogonal interconnections of the Multi-Size Pairings 
memory elements therein, in order to accomplish image The embodiments of the invention described above 
displacements in either the x (horizontal) direction or 20 with reference to FIGS. 3 through 9 employ pixels 
the y (vertical) direction with less delay than the time which represent image sections of uniform size. Also, 
required to read a single line of information from either the spacings between elements paired in each iteration 
memory. with these embodiments bridge a variety of distances 

The processor 80 simultaneously performs the calcu- and extend in different directions. The invention can 

lationsofEquations(l)and(2)toproduceanintennedi- 25 also be practiced using different elements to represent 

ate product For this operation the processor simulta- image sections of different sizes. As with the foregoing 

neously sums, with the adder 88, the three sets of infor- embodiments, these further embodiments can be prac- 

mation identified by the three terms on the right side of ticed using independent iterations or averaged itera- 

Equation (2), i.e. log op(o,o), log r(x,y) and the negative tions, i.e. using either a reset intermediate product or an 

of log r(o,o). To effect this operation, the contents of 30 averaged product as the final combined measure for 

the memory 84 as made negative with look up table 90 each iteration. 

are applied to one input of the adder 88, the contents of A first embodiment of this practice of the invention 

the memory 96 are applied to another input of the ad- with image elements of different sizes is practiced with 

der, and the contents of the memory 84 are applied to a the system of FIG. 3 using the image processors 20, 22 

third input of the adder by way of the delay line 92. The 35 and 24, although it can equally be practiced with the 

delay line introduces a time delay that displaces the same system using the processor 80 of FIG. 9 in place of 

information being read sequentially from the memory each processor 20, 22 and 24. As will become apparent, 

84 in time by an amount equal to the desired (x,y) scroll. the embodiment employs refresh memories with greater 

The processor 80 thus generates the intermediate prod- storage capacity than in prior embodiments to attain the 

uct at the output from the first channel adder 88. 40 same level of image resolution; In this practice of the 

The intermediate product is reset with a transforma- invention, the radiance information identifying the 
tion function similar to that of FIG. 5E by applying the image to be processed is recorded or otherwise stored, 
signals output from the adder 88 to the look up table as in a memory element of the program control unit 56. 
102. For memories 84 and 96 that store radiance infor- The program control unit 56 also records the original 
mation as eight-bit bytes, the reset function for table 102 45 image information, as thus recorded or stored, in a por- 
transforms ten-bit bytes, which the adder 88 produces in tion 120 of the first channel refresh memory 28, as FIG. 
summing three eight-bit input bytes, to eight-bit bytes. 10 shows. The identical image information is also cop- 
The reset product is applied to the second channel ied into four other portions of the memory 28 with 
adder 100, which sums it with information identified by different reduced sizes and orientations, as mapped in 
the additional term on the right side of Equation (4), i.e. 50 FIG. 10 in the memory portions 122, 124, 126 and 128. 
the log op(x,y) term. This information is in the memory The illustrated mapping thus stores five image represen- 
96 and is applied to the adder 100 by way of the delay tations, each perpendicular to and one-half as large as 
line 98, which imparts the same time delay as delay line the next larger one. Further, the several image represen- 
92. The look up table 104 compresses the resultant sum- tations preferably are stored spaced apart 
mation signal output from the adder 100 to effect the 55 Those skilled in the art will recognize that other 
divide by two operation for completing the average devices can be used to generate different size images of 
computation of Equation (4). The resultant averaged the same scene on a single detector array. Except for 
product information is applied by way of the feedback the different orientations, the same image representa- 
path 106 to the second channel memory 96, where it is tions as shown in FIG. 10 can be produced by using five 
written on the same time sequential basis with which the 60 lenses of different focal lengths and five different lens- 
memories are read. to-detector distances. The shortest focal length lens 

The FIG. 9 processor 80 further has a buffer 110 to forms an image representation analogous to the one 

store the information in the memory 96 that is combined mapped in the memory portion 128 in FIG. 10. Each 

with wraparound information from memory 84. The successively larger image representation is made with a 

program control unit 108 reads the buffer-stored infor- 65 longer focal length lens that makes the image represen- 

mation back into the memory 96 in place of the new tation twice the size of the previous lens. The longest 

product information which results from locations that focal length lens forms the largest image representation, 

are paired by way of a time-delay scan wraparound. analogous to the one mapped in the FIG. 10 memory 
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portion 120. This embodiment does not require a high 
resolution record of the entire image in the program 
control unit 56 because each lens in the system makes 
individual minified image representations of the scene. 
The image representations, whether optically or elec- 
tronically minified, are processed in the same manner. 

The FIG. 3 system computes transition measures for 
each image representation, in the same manner as de- 
scribed above with reference to FIGS. 6A through 6D 
and the flow chart of FIG. 4 (and with wraparound 
insulation according to FIGS. 7A-7D), to compute a 
field of new products for each of the multiple image 
representations mapped in the memory 28 as shown in 
FIG. 10. The scroll in each iteration, however, is se- 
lected to compare only elements of the same image 
representation. That is, the image representation stored 
in each memory portion 120, 122, 124, 126 and 128 is 
compared only with elements within that memory por- 
tion. Comparisons between different image representa- 
tions are avoided or are processed as scroll wrap- 
arounds in the manner described above with reference 
to FIG. 7. With perpendicular or like differently-ori- 
ented image representations as in FIG. 10, the system 
operates with uniformly-directed scrolls, which can 
yield economies in implementation. 

Upon completion of the selected number of such 
iterations, the final new products for the several image 
representations in the third channel refresh memory 44 
represent the results of five independent lightness imag- 
ing calculations that use diverse path directions to com- 
pare elemental areas of different real size. The program 
control unit 56 electronically zooms and rotates the 
resultant average products for the different image rep- 
resentations to identical size and orientation, and. then 
averages the several new product fields to form the final 
single field of lightness-imaging products. 

Table I lists, in order, the scroll coordinates for a 
two-hundred -iteration operating cycle for processing 
different image representations as shown in FIG. 10 in 
the foregoing, manner. The Table identifies each itera- 
tion by number, i.e- (1) through (200), and presents the 
(x) and (y) scroll displacement coordinates for each 
iteration. The practice of the invention as described 
with reference to FIGS. 3 and 10 and Table I employs 
larger capacity memories to store the multiple image 
representations with equivalent resolution, as compared 
to the practice according to FIGS. 3 and 6, 
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TABLE 1-continued memory 148 of each processor. The control unit 138 

similarly initializes, preferably with the logarithm of a 
selected uniform radiance field, a correspondingly lo- 
cated one-sixty-fourth portion of the second channel 
5 refresh memory 150 in each processor 140, 142, 144. 
The control unit then performs with each processor a 
selected number of iterations, each as described above 
with reference to FIG. 9, using only the one-sixty- 
fourth portion of each memory which stores image 
1° information. 

Before the program control unit 138 executes a sec- 
ond cycle of iterations, the new product results of the 
last iteration of the prior, first cycle are magnified, with 
Another embodiment of the invention with pairings the zoom stage 145 and by enabling data paths 152 and 
of multi-size image sections is identical to that described 15 154 shown in the processor 144, by a linear factor of 
with reference to FIG. 10 except that each image repre- two to initialize the second channel memory 150 of each 
sentation is processed with a sequence of iterations processor for the next set of iterations. The zoom stage 
which may differ from the sequences used to process 145 initializes each first channel memory 148 with a 
other image representations. Each sequence has approx- sixteen-to-one area reduction of the information field in 
imately the same number of iterations, but the magni- each associated memory 132, 134, 136, using one-six- 
tudes of the distances between paired segmental areas teenth of the refresh memory. The resultant new prod- 
are tailored for each size of image representation. It will uct in each second channel refresh memory 150 is again 
also be apparent that each image representation mapped electronically magnified and placed in a one-quarter 
in FIG. 10 can be processed with a separate image pro- portion of that memory to initialize it for the third cycle 
cessor tailored for the size of whichever image repre- 25 of iterations. Similarly, the first refresh memory in each 
sentation it processes. processor receives, m a one-quarter portion, a four- 

Sequential Progression of Sizes to *° ne m eduction of the original image field infor- 

mation in its associated memory 132, 134 and 136. After 
Alternative to processing the different image repre- executing the third set of iterations, each processor is 
saltations independently of one another, as described *> again initialized, this <fcme using the entirety of each 
with reference to FIO. 10, improved image quality after refresh memory . The results of the fourth set of such 
equal or fewer iterations results when the several image iteratk)ns yi d6 in each second channel memory 150 a 
representattons are processed sequentially and the new fidd of lightness-identifying new product infor- 

product detennuied for each image representatoon is fof vtMag ^ desired of the ^ 

used as the initialized information for the third channel 53 

refresh memory 44 (or for the second channel memory ^ m rfna u ^ mult i le c| 

96 when each processor * of the two^hanne construe- ^ of multip i e iterations ^Zch using a successively 
Hon shown m FIG. 9). It » further advantageous to j fidd taBgBidaiIi6 i Dg fafolmatioa Each 
process the image representations in this ordered se- , . , -°. , r , . r 

* -*i_ !L ii * ■ A ■ An cycle produces a field of new product information 

quence starting with the smallest image representation w J , . , K • , . . t1 \ r . r , . r 

L cu^u.n ;„ xSr- in i~ **>JL* ™a ^ which is electronically zoomed or magnified to form 

as shown in rio. 10 in memory region 128, and pro- . . ... . . , , * - . ■ Jr. ■ , x r 

Rressins to the larcest ^ lmhal old P roduct for * e start of ^ ncxt of 

FIG 11 shows . full^lor image-producing system iterations. FIGS. 10 and 11 thus illustrate practices of 
for this practice of this invention. The illustrated system ^invention using differently-sized image elements m 
has an input stage 130 which applies image-responsive 45 different prcK^ssing iterations. 

radiance information for each of three color bands to . T * k " * a lls ! of to*ly-*»° numbered ^ °? rela - 
different ones of three memories 132, 134 and 136. A tive tone delays for one specific practice ofthe inven- 
program control unit 138, illustrated as connected with *»■ U! ^ f preach of the four cycles as described for the 
all other elements of the system beyond the input stage, system of FIG. 11. 
controls the operation of three image processors 140, 30 TABLE II 

142, 144, illustratively each of the two-channel con- 
struction described above with reference to FIG. 9. 
Each processor 140, 142, 144 is connected to receive 
image information from one memory 132, 134, 136, 
respectively, by way of a zoom stage 145. An output 55 
stage 146 receives the processed image signals from the 
three processors to provide the color masking, exposure 
control and like further signal processing as appropriate 
and to provide the desired display or other output pre- 
sentation of the lightness processed image. 60 

The system first stores the logarithm of the radiance 
information for each element of the image field, for each 
of three wavelength bands, in different ones of the 
memories 132, 134 and 136. The program control unit 
138 reduces the size of the information field in each 65 

memory 132, 134 and 136 by a factor of sixty-four with Another embodiment of the multiple-size pairings 
the zoom stage 145, and stores the minified' image field uses a combination of optical and electronic techniques 
in a one-sixty-fourth portion of the first channel refresh to change the size of the image. Here a zoom lens is 
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employed to make a series'of different size image' repre- This type of camera has a number of unique design 

sentations of the samfc;scene. The system first sets the features that take advantage of the physical properties 

zoom lens to the smallest specified representation of of the components. The individual detector elements in 

objects in the scene. The optical image under this condi- the array 166 can be small, even in comparison to the 

tion includes more of the entire field of view because at 5 size of the individual elements in the light emitting array 

this setting the lens Jtias its widest angle. The desired 170. The latter array in turn is matched to the resolution 

portion of the scene \s imaged in the center of the detec- of the film. The use of a small detecting array is advan- 

tor array and represents the image in relatively few tageous because it allows the use of relatively short 

pixels. The remainder of the image formed by the lens is focal length lenses for the same size final image, i.e. film 

called the peripheral image. In some applications the 10 W8. A short focal length lens 164 means that the 

process can ignore the entire peripheral image by using camera is proportionally less thick, and that the optical 

techniques analogous to those described regarding image has proportionally greater depth of field, thus 

wraparound insulation. In other applications, the pro- making the requirements for focusing less demanding, 

cess benefits from using the peripheral image informa- In addition, shorter focal length lenses have smaller 

tion in calculating lightness fields that are influenced by 15 i/numbera for the same diameter aperture, 

segmental areas outside the final desired image. ^ arrav of charge coupled devices (a CCD array) or 

In both cases, whether the peripheral image is in- of char S e induction devices (a CID array) is particu- 

cluded or not, the lightness field is calculated in the ^ly appropriate for the practice of this invention be- 

manner described with FIG. 9. The long distance, cause ° f " combination of physical properties. First, this 

global interactions are performed first, in relatively few 20 of photoelectric transducer is specifically designed 

iterations. The processed image is then zoomed by elec- '° report the radiances of a large number of pixels 

tronic means to twice its original size by rewriting each Second ' det f tors *° \^ ge ™& f 

pixel in the preceding image representation as four pix- «*~. Ttaa enhances the ability of the system to 

els. If desired, any known shading element can be used „ ? orre * for .? e ^ of radiances fo ™ d 

to smooth the edges of each foutpixel area. THe new 25 m M * nnd dlu ™ons. Third, either array can addi- 

enlarged image is sent to the product memory 96 in t ^ L? ™ 0 ^ evice - ^P™^ dud 
T?ii- q *~ n «Mn/Mi«it> a~**~~i~~* property of the CCD or CID array, being both detector 

FIG. 9 to serve as the array of previously determined and m can lead tQ a ^1^/^ embodiment of 

values for the next stage of computation ^ system piG 9 at least „ ^ ^ e 86 ^ mem . 

next sets the zoom lens to form an, mage twice Aes^e 3Q orie s W and 94 in a single integrated circuit chip. Corre- 

? ™ P « ^ imagC CntCrS 14 at mP StagC 8 r spondingly, a FIG. 3 processor 20 can be constructed 
in FIG. 9 The process then computes the next stage of with at least the mput stage detector 14 ^ ^ first 

the calculation for the slightly less global interactions. chan ne\ memory 28 in a single IC chip. 
The system repeats this sequence a number of times, and ^ embodiments described above thus provide effi- 
for each successive iteration stage, the contents of the 35 cien i lightness-imaging systems that provide both local 
second channel memory 96 are zoomed by electronic and globaI computational interactions of radiance infor- 
means, and the image information in the input stage 86 m ation. A succession of the interactions compares radi- 
is zoomed by optical means, each time to produce im- ance information from image locations that are spaced 
ages of the same size. The final calculated lightness field apart b y ^ order ed succession of distances, or corn- 
has the benefit of both global and local interactions. As 40 radiance information of image representations 
described above, this system can be implemented so that having an ordered succession of magnifications. The 
the lightness field of the desired image benefits from the embodiments further advance retinex processing by 
information in the ultimately discarded peripheral im- operation on a field basis, rather than on a location by 
a B es - location basis. A practice of this feature with a field of 
A Lightness Imaging Camera 45 V 12 ? locations, and employing two memories each 

t having capacity to store the entire field, can rapidly 

FIG. 12 illustrates, in a schematic manner, an applica- calculate and store one-quarter million parallel one-step 

tion of the invention to a self-developing camera 160. A sequences of reset ratio products. The advantage of this 

light-tight camera housing 162 mounts a lens 164 that approach is that a single operation comparing two fields 

focuses the desired viewing field onto the photosensi- 50 of information accomplishes— in this example— one- 

tive surface of a multi-element CCD array 166. The quarter million parallel computations. Succeeding itera- 

array 166 includes the electronic circuits of a program tions can build on the sequential product image in such 

control unit and of three image processors, together a manner that N iterations accumulate information at 

with color masking and exposure control circuits as every location along a patterned N-jump excursion on 

described above. A multiconductor cable 168 applies 55 an individual path. Compared with prior practices in 

the resultant lightness imaging signals to a light emitting which each operation deals with only a single pair of 

diode (LED) array 170. The lightness imaging signals pixels, these features can achieve time savings over 

from the CCD array 166 energize the arrayed, light prior practices of a factor approaching the number of 

emitting diodes to expose a film unit in a film pack 172 locations. 

through a transparent optical plate 174, which could, if 60 The described embodiments manifest a further signifi- 
desired, be lenticulated. The camera includes a pair of cant advance in processing efficiency by using field-by- 
motor driven spreading rollers 176 and associated field processing. 

mechanism for withdrawing each film unit from the Combining image-information fields produced with 

film pack after exposure and ejecting it from the cam- successive processing iterations in accordance with the 

era, as illustrated, with the film, unit 178, in a manner 65 invention has maximal productivity in conjunction with 

which initiates the self-developing process known for another feature which the foregoing embodiments dem- 

self-developing cameras such as those manufactured by onstrate. This feature is the pairing of image field loca- 

the Polaroid Corporation. tions employing a spatial parameter that changes from 
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iteration to iteration. Every pairing, and correspond- 
ingly every iteration, brings to one pixel or location the 
information accumulated by the pixel paired therewith. 
This process yields a geometric growth in information 
accumulation such that there are (2^—1) such accumu- 
lations after N iterations. One end result of a lightness- 
computing process which employs diverse interactions 
in this manner is a real time imaging system. 

Yet another feature of the invention which the fore- 
going embodiments implement is the ordering of itera- 
tions. The resetting function, which the lightness-image 
processing of the invention employs to establish lighter 
areas as references, is a non-linear operation that makes 
the ordering of iterations important. The combining of 
successive iterations in accordance with the invention 
with a geometric average has been found to produce 
optimal results when the larger field displacements pre- 
cede smaller ones. The resetting function preferably 
establishes reference to an extreme or limit level of 
lightness, e.g. bright white or total black. 

Three appendices are attached hereto. Appendix I is 
a computer program listing for one specific practice of 
the invention as described above with reference to 
FIOS. 3 and 6 and using either the eighteen-step cycle 
described with reference to FIG. 2 of a fifty-six step 
cycle. The listing is in Fortran language and is prepared 
for use with an International Imaging Systems Model 70 
image processor controlled by a DEC PDP 1 1/60 com- 
puter operating under RSX 1 1M. 

Appendix II is a further description of a preferred 
form of the color mask stage 58 of FIG. 3 for one prac- 
tice of the invention. 

Appendix III and FIG. 13 further describe a pre- 
ferred embodiment of the exposure control stage 60 of 35 
FIG. 3 for one practice of the invention. 

It will thus be seen that the objects set forth above, 
among those made apparent from the preceding de- 
scription, are efficiently attained. Since certain changes 
may be made in carrying out the above methods and in 40 
the constructions set forth without departing from the 
scope of the invention, all matter contained in the above 
description or shown in the accompanying drawings is 
to be interpreted as illustrative and not in a limiting 
sense. One change, among numerous ones, is that the 45 
invention can be practiced with equipment which oper- 
ates on an analog basis, rather than with the digital 
equipment of the described embodiments. 

It is also to be understood that the following claims 
are intended to cover all of the generic and specific 50 
features of the invention herein described, and all state- 
ments of the scope of the invention which as a matter of 
language might be said to fall therebetween. 



nally, a separate list is included of the subroutines, with 
comments on the functions they serve. 
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Data File for IB-step Operation 


i8.o T ai.ai 


18 jumps, controlled, (not used). 




multi-color, separations 0 to 2 


BAZ4 


1 zoomed face image, scaled to 4 decades 


O 


1 In r# t nntfl *— » f% ot& v kW vi»l* 
1 1411 vol 






256,0, ] 




0,256 ] 




-128,0] 




0,-128] 




64,0 ] 




0,64 ] 




-32,0 ] 






1 18x,y pixel jump components; one pair/line 


16,0 ] 




0,16 ] 




— 0,V J 




0,-8 ] 




4,0 ] 




0,4 ] 




-2,0 ] 




0,-2 ] 




1,0 ] 




0,1 ] 
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A program (named EYEFLY) is provided with a 
data file (in lines 51-77 of the following program lis- 
ting), and the operator controls specific features of the 
sequence of iterations. Two samples of this data file 
follow: The first specifies a set of eighteen iterations as 60 
discussed with reference to FIG. 2. The second speci- 
fies a set of fifty-six iterations for use in producing a 
variety of images that exhibit the effectiveness of the 
process. 

Following the data files is a complete, commented, 65 
277-line listing of EYEFLY, after which appear indices 
of program sections, statement functions, variables, 
arrays, labels, and functions and subroutines used. Fi- 



Data File for 56-step Operation 



56,0,0,1,0,2, 



BAZ4 
O 

.5 m 

128,128 

-128,0 

-128,0 

0,-128 

0,-128 

128.0 

128,0 

0,128 

64,64 

-64.0 

0,-64 

0,-64 

64,0 

64.0 

0,64 

3232 

-32,0 

-32,0 

0,-32 

0,-32 

32,0 

32,0 

032 

16,16 

-16,0 

-16,0 

0,-16 

0,-16 

16,0 

16,0 



56 jumps, controlled, (not used), 
multi-color, separations 0 to 2 
boomed face image, scaled to 4 decades 
threshold =0 grey levels 
Iweightina of old log(Bum)=50% 



1 56x,y pixel jump components; one pair/line 
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-continued - • 



Data File for 56-step Operation 



FORTRAN JV-PLUS V02-51 20:31:22 22^JUL-80 PACE 1 



EYIFLY.FTN /TR:ALL/WR 

0001 PROGRAM EYEFLY 

C EYEFLY does Instantaneous Retinex processing on a (log-energy), image. 

OC02 PAWWETER KXITER-16, MXCTRL-100 

000? INTEGER IDIPJt(0:7) # rDIRY(0?7),UnT^(256>rUmttT(256),TOriX,TOry 

0004 integer indirx(0:7) ,indiry{0: 7) , RANDOM, cfalse.ful img 

0005 integer jixn(n« iter) ,nho(3Et iter) ,lep (rot iter) ,npa(nwiter) 
0005 real cM(roc iter) ,d hi (trot Iter) v ehl{nx iter) , aha (rati ter) 
0007 INTEGER JCX (KXCTRL) rJCY(WtCTOL) 

000B real co(0:l) 

0009 integer buff (2048) 

0010 integer lutlin(256) ,TEMP,avpath(0:2S5,0:l) 

0011 INTEGER FCB(6) ,VRTC,ICHAN(3) ,screch (0:255,0:1) 

0012 byte M0RE,0K,2SLOW # XPATH,onv«rd,ever ,name(30) ,comfil(30) ,basls(30) 

0013 byte tname(30) ,namout(36) 

0014 equivalence (avpath(O.O) ,buf£{l)) ,{lutne9(l), buff (1025)) 

0015 DATA ENDIRX /0,1,1, 1, 0,-1,-1.-1/ 
001S DATA EMDIRY /l ,1,0,-1,-1 ,-1 , 0, 1/ 

0017 oldp(ihop,itot)-C+ D/ihop + (E*ihop)/itot IDefine combining fraction 
C of successive iterations as a function of hop nunber. 

00ie call normal (fcb, buff ,3.-5) 

c 

C INITIALIZE SYSTEM 

C 

0019 call rbutn(fcb,icbut;icx,icy) 

0020 DO 3 tt-1,256 

0021 randy«ran(irl,ir2) 

0022 LUTLIKCN)«N-1 

0023 UITRAT(K)b2*(N*12S) (will expand compressed ratios 

0024 3 LUTNEG(N}-256-N IWill help conpute ratios 

0025 UTTRAK 256) -255 !Else would overflow, from 256 to -256. 

0026 call data (nam*/ 4,, 31, ') 

0027 call data ( basis, *1,,') 
0026 do 4 ml, 1024 

0029 4 buff(n)*0 

0030 call o£m(fcb,buff ,1,0,0) I make blue invisible; green will be 

C too, due to CONST, tnost of the time, except in FREEZE. 

0031 DO 434 N-1,2S5,2 

0032 SCRACH(N,1)«0 

0033 434 SCRACH(N,0)-N lODD-WlfBER SIGNS FULL-WEIGHT TO OLD PRODUCT. 
C 

0034 CALL. LOT(FOB,LUTN&C,2 r 4,0,D) (Green gets nag. input from Chan. 2 

0035 CALL LuT(FCB,LUTLXK,2,2,0,O) 

0036 CALL LTCN*T(FOB,6,2,0,0) ! Green • channel 1 - channel 2 

0037 CALL LLrnFCS, LuTRAT,4,2,0,O) ! Ready to use ratios 

003B CALL LUT(FCB,LuTLXN,4,l,0,0) I AND old sequential products 

0039 DO 20 N-1,512 !IFM naps -255 to 0, 0 to 127, and 255 to 255. 

0040 TEWP-(t*-l)/2 

0041 IF(IA3S(J+-255) .LE.INTEPS) TEKP-127 

0042 20 buf f (N)*TEMP 
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39 40 

0043 CALL IF*(FtB f buff,S12,511,0,0,0) J CHANGE, 2/20/80, TO LOAD ONCE ONLY 
C ISE GREEN C0NST*512{ wu't affect normal feedback of green,ETCPiFH. 

0044 coll const(feb,0,5L2,0,0,0) 

0045 do 30 j-1,256 

0046 30 buff(j)-j-l 

0047 do 31 j»257,511 

0048 31 buff (j) -255 jtfilte referenc. ^rces all Uiite-exceeders back to 25$. 

0049 call ifin(fcb,buff,0,5U,0,0,0) 

0050 type 19,* *,7 



C 

C DETBWINE MAKE OP CONTROUINC DATA FILL "> OPQ4 IT 

C 

o 



0051 call d«w>( ' EYEFLY* , input) 

0052 ityp*> 

0053 if(input.ne.l) 90 to 2300 

0054 type V&iter data file for EYEFLY. • 

0055 accept 19, (canfilf j) ,j-l,29) 

0056 DO 2200 N»l r 29 

0057 I*(O0MFIL0^).N£.• •) ityp-i 

0058 2200 CONTINUE 

0059 2300 IF(ITVP.EO.O) call data (cowf 11/ [1, 5Jeyefly.dat • ) 
DO 60 OPEN (UNIT*2, NAHi>carT\fil,TYPE» , OLD' .READONLY) 

0061 read (2,9) nhi ( RMaXM # cfelse # fuling^Dinch v Baxch 

C —Input | hierarchies, random/controlled switch, multl-color/1 separation 
C — switch, unused variable CFALSE, niniiium, ■axinun color channel |*s* 

0062 namlet*4 

0063 if(fuling.eq.l) nanleb-7 

0064 read (2,19) tneme(i) ,I«nenJet,29) 

0065 if (RANDQM.NE.l) GO TO 350 

C 

C FOR RANDOM WALKS, for each •hierarchy of level", 

C here input the jump size, # jumps, threshold, » paths, % that jump ahead, 

C 9 and coefficients for pooling fraction. 

C * 



0066 do 300 n-l,nhi 

0067 read (2,39) jumfn) ,nho(n) , Sept n) ,npa(n) , aha (n) 
0066 300 read (2,69) ehi(n) ,dhi(n) ,ehi(n) 

0069 00 TO 400 



C * 

C OR, FOR CONTROLLED JUMPS, read in the single threshold, pooling 

C fraction coefficients, and the x,y f components of every 

C jump-vector, and conventionally define exactly one "hierarchy* 

C of one "path" composed of these vectors. 

0070 350 read (2,9) inteps 

0071 read (2,69) C,D.E 

0072 do 360 n-l,nhl 

0073 360 read (2,9) joc(n) , jcy(n) 

0074 num-nhi 

0075 WHI-1 INS I for controlled series-1 long path of variable juop-sizes! 

0076 HPATH5-1 

0077 400 CLOSE (UNIT-2) 
*■ 

C 

C DETBWINE THE KWffiS OT INIVT t OUTPUT DUCES 



0078 




0079 




0080 




0081 




0082 




0083 




0084 


490 


0085 




0086 


495 


0087 


496 


0088 


2400 


0089 




0090 




0091 




0092 




0093 




0094 




0095 




0096 




0097 


2410 


0098 





if (input. ne.l) go to 2400 

type 509,7, (namc(l) ,i»nenlet,29) 

if(fulisg.eq.l) type *, 'will store sections of color image: 

1 <ret> or enter input iHAGE-nawe. 1 

accept 99 , (tnaroe( I) # i-nanlet , 29) 

do 490 S-nam3et f 29 

if (tname(j) ,ne.* ') go to 495 

continue 

GO TO 240O 

do 496 j*n*nlet,29 

nane(j)»tnaoe( j) jte allow terminal input of image- name 

nribend*0 

Kxband-0 

if (fuling .ne.l) go to 2500 

■rfeandninch 

BMbantaoexch 

call data (nsmout, 31V) 
call data(naraout(9),name(7)) 
do 2410 1-9,30 

if(namout(l).ecj.* ••or.namout(l) .eq.*.*) goto 2411 
continue 

stop 'Disk filename too long.* 
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0099 


2411 


0100 




0101 




0102 


2415 


0103 


2420 


0104 




0105 


2500 


0106 










C 




C 




c 
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41 42 

if(namDUt(l).e<^ , .•} go to 241S 

namout(l)«'P' ! processed images gets B P" at the tnd of Its ncni. 

go to 2500 

do 2420 ft-29,1+1,-1 

namout<n)«namout(n-l) Ibunp letters forward to make roan fbr.^P" 
namout(l)»*P* 
continue 
* TXMEO-secnds(0.) 



LOOP OP DIFFBUNT COLOR SEPARATIONS 

0107 00 3000 XBANl>fCSAND r WCAKD lllldo multiple colors In one riffilll!! 

0106 cell ones< buff ,1,-1) 1WREF (all bits on) in ehan. 0. 
C ■ 

c 

C LOOP OF SUCCESSIVE HIERARCHY LEVELS FOR RANDOM PATHS 

C OF BXFFDtQfT JUHP-5IZE 

C 

C i 11 1 1 

0109 do 500 rai-a,mi 

0110 lf(fulis9.«q.l) nane(51-ibHidV'0 v J input channel picked from image 

0111 call darr(naae) 

0112 type *,» * (skip along, ao TDTX etc. doesn't over-write messages. 

0113 if (randoo.ne.l) 90 to 150 

c 

C INITIALIZE HIERARCH¥-5reciFIC C06TWTS (jimp Size* 

C possible vector components, pooling fraction coefficients) 



0114 junpszpjun(ihi) 

0115 ZPAR-512-JWP52 J Car edge of screen (requiring insulation) starts here. 

0116 nuwnho(ihi) 

0117 intepe-iep(ihi) 

0118 npaths*npa(lhi) 

0119 ahead-aha(lM) 

0120 e-chi(ihi) 

0121 d-dhi(ihi) 

0122 e-ehi(lhi) 

0123 TYPE •/Jump f.ise (max 8) t | of hops, integer thresh, NPATH5, 
1 AHEAD (4i5,f7.2>« 

0124 TYPE 39, JUMP52,NUM I in teps r NPATHS, AHEAD 

0125 if(npoths.le.O) npaths-1 

0126 if (ahead. le.0) ahead*0.3 

0)27 type *,*Real coefficients C,D,E to eele. fraction weighting old SEQPR* 

0128 , type 79,num,min 

0129 "' tXPZ 69.c,d,e 

0130 type *,'Hit button A to pause and consider early exit. 1 

0131 TYPE 19 lSpece forward 

0132 5 IF(JUMPS2.LT.O .OR. JUMPSZ.GT.504) JUMPSZ^ 

0133 DO 6 M-0,7 

0: 34 IDJRX (N) -INDIRX (N) MUWPSZ 

0135 6 IDIRY(N)-IWDIRY(H)*JUKPSZ 



C LOOP OF KULTIPLC PATHS AT GIVEN KIERA7XHY LEVEL 

C (First, initialize path-specific parameters) 

c 

0136 150 do 200 np-l,npaths 

0137 lastgc-ran(irl,ir2)*8. 

0138 TOTX«0 

0139 TOTY-0 

0140 if (np.eq.l.or.lhi.gt.1) 90 to 8 

0141 call onestbuff ,1,-1) IVfiEF (all bits on) in chan. 0. 



C 
C 

C LOOP OP IKDTVIDIM. JOTS —the INNER WORKINCSli 

C - • : 

0142 8 DO 100 NH0P»l f NUM 

C if (KOSTOP.eq.l) CO TO 16 
C 

C Optionally, view progress on this path so far. 

O 

0143 if (NEEDCR.eq.l) call rbutn(fcb,icbut,ix,iy) 

0144 CALL RBimi(FGB v XBUr,IX,XY) 

0145 MEEECPM) I usually will not need to clear button next time. 

0146 IF(IBUr.lC.l) 00 TO 16 

0147 . TYPE *, , HIT button B to resume process, C to see original, D to exit.' 
0146 TYPE 19 1 Space forward 

0149 7 call waitic(2) 

0150 call rbutn(fcb,ibut,ix,iy) 

0151 lf(lbift.M.l.and.ibii£.m.2.ar4.rfiUr.NE.3.s^ 
1 go to 7 
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0152 
0153 
0154 
0155 
0156 
0157 
0158 
0159 
0160 
0161 



0162 
0163 
0164 
0165 
0166 
0167 
0168 
0169 
0170 
0171 



0X72 
0173 
0174 
0175 
0176 
0177 
0178 



0179 
0180 
0181 
0182 
0183 
0184 

0185 
0186 
0187 



if (ibut.eq.B) call exit 
l£(ibut.«q.2.ot.IBlff*E0^3>^9O>to i5- , 

call ltcnt(fcb,ibut,4,0,0) ] show channel 0 vs. channel 2 
go to 7 

15 NEEOCR-l lout -hart* awat- clear*. and now i* too sarly. 
call ltcnt(feb,l,4,0,0) 

16 if (ibut.ne.3) go to 17 

type *, 'Enter FREEZE Bask: 1 shift, 2 ratio, 4 nav product' 
accept 9r»£ro» ■ . . . . .. u . 

17 ZF (RANDOM. NE. 1} GO TO 11 

C ... ,„i. 

' c 
c 

c ' 
c 



10 



c— 

c 
c 
c 
c 

o— 

11 



12 



IF RANDOM, tCTOMXHE SPECIFIC VECTOR TOR THIS JIM?: 
(probability - 1. -AHEAD of veering of f course of last junp) 



randy* ran ( In , Ir 2) 
WOVE-LASTGO 

IF( randy. le. ahead) GO TO 10 
IDEL-1 

IF(randy.LT.(1.4ehead)/2.) II«:t>-l 

HOVE-JFWCD (LASTOO+IDEL, 8) 

LASTOO-MOVE 

HOVX-IDIRX(MOVS) 

HOVy-IDIRY(MOVE) 

go to 12 



OR, TAKE VECTOR from Input list, and find 

Its magnitude and that of complementary wrap-around edge. 



-jex(nhop) 
novy*jcy(nhop) 

juspsz^ax (abs(movx) # aba(BOvy) ) 
lfar»S12- jump»r 
TOTX^TOTX+HOVX 
TOTY*IOTY*HOVY 

TYPE 49»T0TX,TOTY,nhop I Type accunulated excursion of jumps so far. 
DfTEMD SEOuTWTIAL FRCOICTS! 1 1 1 1 1 1 1 1 1 1 1 1 1 1 f II II 1 

Mext five lines beginning with "CALL..." perform the vital functions: 

1) 9ilft Original Image 

2) Feed it to Intermediate Channel 

3) Feed back Ratio of shifted original to the Interned i a te.Oiannel 

4) Enable the Contributors to the Interned late Product 

5) Feed the Intermediate product back to the Interned let* Qiannel 

CALL LTC»r(KB,4,l,0,0) ! Enable blue from chin. 2, latest image-shift. 
CALL feednS (buff, 1,1,-1, l,n0VX,MGW) 

if(iand(mfroze,l).ne.O) call freeze (2, 2) I (optional pause for • look) 
CALL FDBCK(f€B,2,2,*l,0,0,0,0) i Store •ratios* in channel 1. 
CALL LTCNT(KB,3,4,0,C) IRad from (log seqpr)+(log ratio) • . 
lf(iand(afrose,2)^ne.O) cell freexe<2,4> - IRES uses ratio LOT 

I (optional pause for a look) 

CALL feedsfi (buff ,4, 1,-1, 0,0,0) . 

if(iand(mfroxe,4).ne.O) call freeze (2, 2), I (optional pause for e look) 
call 1 tent (fcb,l r 4,0,0) I want to vetch the progress of sequential prod. 
ZF MOVEDX), influence just spread in positive direction, so 
we Bust safekeep 1st several rows f ran wrap-around by copying 
the OLD product (chan. 0) there into the part of new product 
(far edge) that WOULD otherwise change then when old, new are 
averaged . 

IF N0VEDO, vice- ve r s e . That is, safekeep higher rows of old 
into lower of new. 

—Revision AGAIN, 2/16/80, 11 pm. New method is faster and will handle 
eases where both MOW and MOW ere, nonzero., wrap-around tones are 
marked with ones in bit-plane zero (detail lost anyway with C*.S0!} 

These marked areas effect 100% weighting of old product, thanks 
to 434-loop initializing of SCRACH arrays, above. 



01 B3 
0189 

0190 
0191 
0192 
0193 
0194 
0195 



CLEAR OUT ROOM FOR and then HARK WRAP-AROUND ZONES 



call fdbck(fcb,2,3,l,l,0,D,l) J 2ero out plane 0 of cha ts 0,1 V 
JF(JUK?SZ.E0.2S6> GO TO 1035 

1N0 "wrap-around* worries for unique JUMPS?- (rcr ten wfdth)/2! 

do 1030 :H>,1 >; v • ■ ■ ' - ; ■ - ' 

movedxmovy 13 (direction) 0»> rows, for which y-chsnge is, key. 
if(j.eq.l) moved-novx 

if (moved .eq.O) go to 1030 I no work needed . . - > ^ 

ifrom-0 . :\ .?'< ■ ■.■>-..-. 
if(moved.lt.O) Ifrowifar 
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0X96 ito-ifar-lfron 

0197 call markl(buff,jmp6r,ifra ( ito.l,j.2)- - .* 

0199 1030 continue 

0199 1035 continue 

0200 my»-»ovy 

0201 ax»(-mov*/8)*8 

0202 if [mx.lt.-movx) mx*rar+f 

0203 ipx*mx- (-movx) iNeed to "unseroll" the new sequential product 

C before it can be (averaged with old) and fed back to chan. 0. 

C So, as in feedm2, w break iom every X scroll into e scroll and 

C a (negative) right ward 0-7 pixel offset: do the offset first. 

O i 

C 0-to-7 pixel "offset" for precise unaerolling 

0204 if(ipx.eq.O) 90 to 33 

0205 call imagetfcb,buff,5a2-ipx,0 ( 512*ipx, 1,2, -1,1, 1,0,0,0,0,1) 

0206 CALL LTO*r(FCB,2 # 2,0,0) 

0207 call ttbck(fcb,2, 2,-1, l#ipt ,0,0) 

020B call ltcnt(fcb,6,2,0,0) !Get green ready for next RATIO acsin. 

0209 call image(fcb,buff,0,0,512*ipx,l, 2,-1,1,1,0,0,0,0,0) 



C- 

C (Residual) UN -SCROLLING OF INTERMEDIATE PRODUCT 



0210 33 call scrol (fcb,ntx,ny, 2,0,0) 



C 

C SET UP COMBINATION OF IWTCTMEDIATE, PREVIOUS PRODUCTS 
C 

c , „ 

0211 if (nhop.gt.l.and.d.eq.O.and.e.eq.O.) go to 435 1SCRACH arrays ready. 

0212 oh»oldp(nhop,nixo) 

0213 if(oh.lt.O) oh-0. 

0214 if(oh.gt.l.) oh-1. 

0215 eo(0)«oh 

0216 co(l)-l,-oh 

0217 do 34 ic-0,1 
0216 do 34 m0, 254,2 

0219 34 scraeh(n,ic}«eo(ic)*n 

0220 do 35 ic-0,1 

0221 35 call lut <fcb, screen (0, ic) ,1,2** ic, 0,0) 

0222 435 call ltcnt(fcb # 3, 1,0,0) I Blue tdll be a weighted avg. of old, new SEOPRs 



C 



C . reed back Cunblnation to SEQUENTIAL PRODUCT CHANNEL 

0 



0223 36 call fdbck(fcb, 1,1, -1,1,0,0,0) 
C ■ 



C REV2ERO the scrolling register needed for "UN-SCROLLTIC* 

O 



224 call aerol(fcb f 0,0,2,0,0) I TROUBLE, if don't reset. 

225 100 CONTINUE 

226 ^ iftnpaths.eq.l) 90 to 200 J no averaging to dot 

. c . 

C ' CALCULATE RESULT FRO* AVERAGE OF MAW PATHS, and 

C (optionally) compare it to single most recent path. 



227 xr(NP.hE.O) call dazs('2,,,aye.te»;l*) 

228 do 180 n-0,255 

229 •vpath(n,l)-((np-l)*float(n))/floaL(np) {average of old paths 

230 160 avpBth(n,0)«float(n)/float(np) lnrw path 

C Weight accumulated avg. UP by a factor of (NP-1) compared to now sirnl* path. 

231 do 1B5 rW>,l 

232 165 call lut(fcb,avpeth(0,n) ,4,2++n,0,0) Imake RED - updated average. 

233 call ltcnt(fcb,3,4.0 f 0> 

234 call fdbck(fcb,4, 2,-1,1,0,0,0) 

235 CALL LUT(FCB,LUTLIN r 4 f 3,0,0) I for examination, linear; later restore PAT 

236 call 1 tent (f cb, 2, 4, 0,0) 

237 type 59,7,np,np 
23fi ipushd-0 

239 lteit-0 

240 190 call «*itic(2) 

241 i*eit-i%»itU 

242 lf(ipushd.eq.0.and.iiAlt^t.30) go to 195 J so prog can run several 
C I paths on its own. 

243 call rbutn(fcb,ibut,U,iy) 

244 if(ibut.ne.l.and.ibut.ne.2.and.ibut.ne.4.and.ibut.ne.8) go to 190 

245 ifUbut.ec.. 8) go to 195 

246 call ltcnt[fcb,ibut,4,0,0) 

247 ipushd*l I Once you make a request, must push D to go on. 

248 go to 190 

>49 1 95 call rbutn(fcb,icbut,ix,iy) I a ear button 

250 call daxz(*2,l,,eye.tem;l*) 

»51 if(np.eq.npoths) go to 200 
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!52 
!53 
>S4 

!55 
!56 
157 

158 
•59 

!60 

•61 
:62 
:«3 

!64 

!S5 
'.66 



267 
266 
2G9 
270 
27X 
272 

273 
274 

275 
276 



call ltcnt(fcb,l, 4,0,0) 

call lut(fcto,lutrat,4,2,0,0) i ratio* from chin I to Red enabled, AGAIN! 
200 con ti not 

£*•»**»**•••••*•*•*•* 

XF(N8I.t£.l) CO TO 500 
call ltent(fcb,2,4,0,0) 

call fdbe*(fcb,4,l,-l # l#0,0,0) Iftod red <*vg. at this level) 
C to channel 0 Cor next level 

call ltcnt(fcb,M,0,0) 

call lut C f cb, lutrat, 4,2,0,0) I ratios fran.chan l-> Red enabled, AGAIN! 
500 continue 

if < fulling .ne.l) 90 to 1000 I skip storing of results. 
namout(3)»*+ v 

if {ibani.gt.O} najnout<3)**-* 1HCTCT: a red record is written to NEW 
C filej ether records augment or update an OLD file. 

nm>ut(7WbanoVD* 

call dazz(namout) 
1000 cent tnue 

£•••*•*•••*•»**•**•****•****»************ 

type */Tiine elapsec>\s4cnds(tia^), 'seconds.' 
9 r0fi«AT<16l5) 

19 rom*r<60Ai) 

39 fOWAT <4iS,f7.2> 

49 FORMAT < , 4TOrx,TOT)f\2l5/ *»P #\15) 

59 forwt (lXfal,*P«thM3/ donei button Mast, swj. of ',13, 
1' C-original, DK30 ON)*,/) 
' 69 format (10f6.2> 
79 format (• function is C ♦ D/nhop +E*(nhD|V W) , nhop varying 

1 froei 1 to', 13/ on each path. 1 ) 
99 format (80*1) 

509 format (lx,al,' <retum> to process 26a 1,' ; or enter IDISK, 
1 Input-file.') 
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r*oowti sections 

NlMER mac 



size 



i 


cooori 


016734 


2208 


2 


SPDATA 


0010V6 


207 


3 


SI DATA 


0016G0 


472 


4 


sums 


016220 


3683 


6 


STOPS 


eooaio 


4 



ATTRIDUTES 

RH, I t COH,LCL 
PH.D.COH.LO. 
RH, D, CON, LO- 
RN, 0, COM, LCL 
m.D.COH.LCL 



STATDUfT rucnofs 
MWC TYPE ADDRESS 
OOF PJS4 1-410679 



NAME TYPE ADDRESS N«»C TYPE ADDRESS MWC TYPE ADDRESS NAME TYPE ADDRESS 



mc TYPE 


ADDRESS 


NAME 


TYPE 


address 


NAME 


TYPE 


ADDRESS 


NAME 


TYPE 


ADDRESS 


NAME 


TYPE 


ADDRESS 


IWO R*4 


4-416136 


C 


ft*4 


4-016Q32 


CFflSE 


1*2 


4-011106 


0 


R*4 


4-016030 


E 


R*4 


4-016042 


E«H L*l 


4-01ES7S 


FIJLIMC 2*2 


4-01 U 10 


X 


1*2 


4-0161GB 


i awe 


1*2 


4-016126 


IBJT 


1*2 


4-016150 


tc xtz 


4-016212 


ICBuT 


t*2 


4-01C04S 


xcx 


1*2 


4-016050 


ICY 


1*2 


4-016052 


I DEL 


1*2 


4-016164 


irm 2*2 


4-016134 




1*2 


4-01G174 


XHI 


1*2 


4-016130 


IHDP 


1*2 


r-ooooaa 


INPUT 


IT2 


4-016072 


XNTCPS 1*2 


4-0160G6 


IPATW 


Ul 


4-016573 


IPU6HD 


i X*2 


4-01S214 


IPX 


1*2 


4-016204 


ID1 


1*2 


4-016062 


IR2 IB2 


4-016064 


ISU3U 


L*l 


4-0)0572 


no 


1*2 


4-016176 


I TOT 


1*2 


r-ooouo-u 


XTYP 


If2 


4-016074 


WRIT 1*2 


4-616216 


IX 


1*2 


4-01GIS2 


IV 


1*2 


4-016154 


J 


1*2 


4-016O7B 


JU*SZ It 2 


4-016132 


L 1*2 


4-816120 


LflSTCO 1*2 


4-016144 


MHHCH 


1*2 


4-01CI02 


hTROZE 1*2 


4-O161G0 


MINCH 


1*2 


4-016100 


rate x*2 


4-016L14 


MORE 


L*l 


4-OIS570 


MOXC ' 


1*2 


4-016162 


HOMED 


1*2 


4-01G172 


MOUX 


1*2 


4-016168 


MOW IS2 


4rO16170 




1*2 


4-016202 


MXWND 


1 1*2 


4-016116 


MY 


1*2 


4-016200 


N 


1*2 


4-016O54 


nrhlet i*2 


4-016104 


fCEDCR 1*2 


4-916153 


NHI 


1*2 


4-01E076 


WOP 


1*2 


4-016146 


NP 


1*2 


4-016142 


rfWHB IS2 


4-016112 


NUM 


1*2 


4-016110 


OH 


R*4 


4-016206 


OK 


L*l 


4-015571 


ONHfflO 


1 L*l 


4-61S574 


RANDOM 1*2 


4-011104 




R*4 


4-OlGOtK 


TEMP 


1*2 


4-813S42 


TIMfJQ 


R*4 


4-016122 


TOTX 


1*2 


4-011040 


T0TY 1*2 


4-011042 


URTC 


142 


4-O13S60 





















NAME 


TYPE 


address 


SX2C 




OlhTJfiXQNS 


AHA 


R*4 


4-011612 


000100 


32 


<18> 


AHWTH 1*2 


4-OOOCCO 


002000 


512 


tOZ^Oi) 


BASIS 


Ltl 


4-01UJ72 


000Q3G 


16 


(.?0> 


buff 


X*2 


4-OJ0000 


010000 2040 




Oil 


RM 


4-011312 


OU0100 


32 


( 16) 


CO 


RM 


4-01£532 


000910 


4 


(0 1) 


COMTIL L*l 


4-01SC34 


000036 


IS 


(30) 


CHI 


RM 


4-011412 


OOOIOO 


32 


<1G> 


CHI 


R*4 


4-011512 


006100 


32 


<16) 


res 


1*2 


4-013544 


000014 


6 


(6) 


ICHAN 


1*2 


4-013562 


Bfg»)a6 


3 


(3) 


IDIRM 


1*2 


4-O10ODI3 


000020 


8 


<Q?) 


1MRY 


1*2 


4-010020 


0GO3£8 


S 


(0*7) 


ItP 


lt2 


4-011212 


OCOMO 


16 


(1G) 


1N0IRX 1*2 


4-01 10-M 




0 


<C*7> 
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IfOIRY 1*2 


4-011DG4 


000GC9 


8 


(0=7) 


JCX I»2 


4-011712 


eoojio 


100 


(ice> 


jcv It2 


4-012222 


000310 


180 


(100) 


Juri x«z 


4-611 HZ 


000040 


16 


ilC» • 


LUTLIN 112 


4-612542 


ooimo 


256 


<2E6> 


LUT1CG IJ2 


4-001900 


OOlOOO 


256 


(2SG> 


UJTTJflT 1»2 


4-610048 


001QQ0 


ZOS 


C256> 


mate L»i 


4-61SS7P 


000036 


15 


(30) 


hOIOUT Ltl 


4-0157C6 


OOUO-M 


18 


C36) 


rH9 1*2 


4-B111SZ 


000040 


16 


(16) 


tPft Jt2 


4-G112!i2 


600048 


1G 


(16) 


SCRRCH 1*2 


4-01357B 


Q07B00 


S12 


< On 255, a 11 


TNRfC LAI 


4-815730 




15 


<38> 



50 



JKLS 



LABEL 


ADDRESS 


LABEL 




LABEL 


ADDRESS 


LABEL 


ADDRESS 


LABEL 


ADDRESS 


3 


r» 


4 


** 


e 


»* 


6 


*• 


7 


1-004724 


8 


1-Q04S40 


B* 


3-000000 


io 


1-0054GC 


11 


1-005530 


U 


1-0QS66O 

r* 


15 


1-005125 


16 


1-BE1EC 


17 


1-0OS2SO 


1* 


3-000004 


20 


38 




31 


« 


33 


1-00G674 


34 


9+ 


35 


»» 


36 


»* 


39* 


3-GGQ010 


49T 


3-OUOQ20 


S3* 


3-C08GS4 


GO* 


3-000154 


79* 


3-000172 


99* 


3-000316 


100 


•« 


150 


1-O04374 


10B 


*t 


185 


*♦ 


199 


t-eioooG 


195 


1 -010330 


£00 


1-010276 


308 


** 


350 


1-602020 


368 


** 


400 


1-002272 


434 


M 


435 


1-607264 


458 


m 


495 


1-002524 


498 


♦ * 


£00 


1-610420 


EPS- 


3-000322 


1000 


1-010558 


1030 


1-006370 


1835 


1-005412 


2200 


*• 


2300 * 


1-061266 


2-109 
2500 


1-60ZG65 
1-603238 


2418 


M 


2411 


1-003102 


2415 


1-003144 


2420 


•« 



OrcnCNB AND SUOROUTItCS REFERENCED 
GLOS* CONST. DATA DAZZ DEMO EXIT 
CFM ONES (AM RAN RBUTM SCROL 



FD8CK FEEDH2 FREEZE IFM 
SECNOS WR1TIC S4W8 



LTCNT LUT 



MRRK1 -MORMRL 



TOTAL SPACE ALLOCATED - 032142 8705 

.DPI' £ I , SB )Dm.Y/T«)6P/tI: 6-IP1 = tl,S5JCYCFLY 
SUBROUTINE C3NST (FEB, CGNB, CONG, CONR, V RTRTC, READ) 

SUBROUTINE REUS OR WtmS THE CONSTANT REGISTER. . 

INTEGfR FCB(1>, CONB, CENG, CONR, VRTRTC, READ 

COMB - THE ADDITIVE CONSTANT USED BY THE BLUE SUM PROCESSOR 
CONG - THE ADDITIVE CONSTANT USED BY THE GREEN SUM PROCESSOR 
COKR - THE ADDITIVE CONSTANT USED BY THE RED SUM PROCESSOR 
READ - 0 IMPLIES WRITE, 1 IMPLIES READ. 

SUBROUTINE FDBCK (FCB, COLOR* CHANL, BITP, BYPIFM, 
1 PIXOFF, EXTERN, ZERO) 

I NTEGER FCBfl) , COLOR, CHANL, BITP, BYPIFM, PIXOFF 
INTEGER EXTERN, 2ER0, VRTRTC 

SUBROUTINE TO READ AND WRITE THE FEEDBACK LOOP CONTROL WORD 



FEB 
COLOR 



CHANL 



- AN INTEGER ARRAY USED FOR SYSTDi DEPENDENT INFORMATION 

- COLOR SELECT WORD 

4 *> RED, 2 ■> GREEN, ) •> BLUE 

- A BIT MAP SELECTING THE CHANNEL FOR THE DESTINATION 

1 -> IMAGE 0 

2 «> IMAGE 1 
4 •> IMAGE 2 



1G384 -> IMAGE 14 
-32768 ■> IMAGE 15 (GRAPHICS) 

BITP - A BIT MAP SELECTING THE BIT PLANES TO READ/WRITE 
NORMALLY -I. I.E. ALL BITS. THE EXCEPTION TO THIS 
RULE IS WHEN WRITING IN THE GRAPHICS CHANNEL. 

BYPIFM - 0 IMPLIES USE IFM, 1 IMPLIES BYPASS IFM. 

PIXOFF - PIXEL OFFSET, 0 <• N <« 7. 

EXTERN - 1 IMPLIES EXTERNAL INPUT, I.E. DIGITIZER 

ZERO - 0 — > NORMAL; 1 — > FEED BACK ALL O'S 

(USEFUL FOR BLANKING THE DESTINATION CHAN.) 

SUBROUTINE IFM (PCB, MAP, START, COUNT, PACK, VRTRTC, READ) 

SUBROUTINE TO READ OR WRITE A SECTION OF THE INPUT FUNCTION MEMORY (IFM) . 

I NTEGER FCBtl), MAP(l) , START, COUNT, PACK, VRTRTC, READ 
INTEGER BITS (16), PBITS 

MAP - A 'COUNT' WORD ARRAY TO RECEIVE/CONTAIN THE IFM CONTENTS 
START - THE POSITION {ZERO REL) IN THE IFM WHERE THE 
TRANSFER IS TO START 
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4,384;336 

COUNT - TOE NUMBER OF IFM ELEMENTS TO TRANSFER 
READ - 0 IMPLIES WRITE, 1 IMPLIES READ. 
PACK - 1 IMPLIES PACKED MODE TRANSFER 
SUBROUTINE IMAGE (FOB, PIXELS, 

1 XINIT, YTNI7, NPIXEL, DIRECT, 

2 ChANNL, PLANES, 

3 PACKED , BYPIFM, BYTE, AECWRT, BURST, 

4 VRTRTC, READ) 

SUBROUTINE READS OR WRITES IMAGE DATA. 

INTEGER FC3U), PIXELS(l), XJNIT, YIN IT, NPIXEL, DIRECT 
INTEGER COUNT, CHANNL, PLANES 

INTEGER PACKED. BYPIFM, BYTE, AEEWRT, VIDORD, BURST, VRTRTC, READ 

PIXELS - AN INTEGER ARRAY TO RBCETVE/OKTADJ THE IMAGE DATA 
XINIT - THE X-COORDINATE OF THE FIRST PIXEL TRANSTSRED (0 RELJ 
YINIT.,- - THE Y COORDINATE OF THE FIRST PIXEL TRANSFERED (0 REX) 
NPIXEL - THE TOTAL NUMBER OF PIXELS TO TRANSFER 
DIRECT - 0 IMPLIES READ/WRITE PROCEEDING TO THE RIGHT, 

1 IMPLIES READ/IWIE PROCEEDING DOWNWARD 
CHAWL - A BIT MAP SELECTING THE CRJWEUS) TO READAWTEr 

1 -> IMAGE 0 

2 -> IMAGE 1 
4 -> IMAGE 2 

ETC. 

16384 -> "IMAGE 14 
-32768 -> IMAGE 15 (GRAPHICS) 

WHEN WRITING ONLY, THESE CODES MAY BE COMBINED 
TO WRITE THE SAME DATA INTO TWO OR MORE CHANNELS. 
FOR EXAMPLE, CHANNL - -3275B WOULD MEAN CHANNELS 
I, 3, 4 15. 

PLANES - A BIT MAP SELECTING THE BIT PLANES TO READ/WRITE, 

NORMALLY -1 , IE, AIL BITS. THE EXCEPTION TO THIS 
RULE IS WHEN WRITING IN THE GRAPHICS CHANNEL. 

PACKED - 0 IMPLIES 1 BYTE/WORD, 1 IMPLIES 2 BYTES/WORD 

BYPIFM - 0 IMPILES USE IFM, 1 IMPLIES BYPASS IFM 

BYTE - 0 IMPLIES NORMAL, 1 IMPLIES 8 PIXELS/BYTE, 
I.E., BINARY DATA. 

** NOTE - XINIT MUST BE A MULTIPLE 3TB 
AEDWRT - 0 IMPLIES NORMAL, 1 IMPLIES THAT TOE DATA St 

"EMORY (S) IS OR* ED TO THE DATA PRESENTED FROM 
THE COMPUTER AND THE RESULT IS STORED IN THE MEMORY (S) . 
*♦ NOTE - USED WHEN WRITING ONLYJ1 
BURST - 0 IMPLIES NORMAL TRANSFER, 1 IMPLIES BURST (FAST) XFER. 

** NOTE BYTE-1 MUST BE SPEC IFIED . 

VRTRTC - 0 IMPLIES WRITE ANYTIME, 

1 IMPLIES WRITE DURING VERTICAL RETRACE ONLY. 
READ - 0 IMPLIES. WRITE, 1 IMPLIES READ. 
SUBROUTINE OFM (PCS, MAP, COLOR, VRTRTC, READ) 

SUBROUTINE TO READ/WRITE AN ENTIRE OUTPUT FUNCTION MEMORY (OFM) 

INTEGER FCBC1), HAP (1024) , COLOR, VRTRTC, READ 

MAP - A 1024 WORD ARRAY TO RECEIVE/CONTAIN THE OFM CONTENTS 
COLOR - A CODE INDICATING WHICH OFM TO READ/WRITE: 

1 -> BLUE 

2 -> GREEN 
4 -> RED 

WHEN WRITING ONLY, THESE CODES HAY BE 
COMBINED TO WRITE THE SAME DATA INTO TWO 
OR THREE OFM'S. FOR EXAMPLE, COLOR«S WOULD 
WRITE BOTH THE BLUE AND RED OFM'S. 
READ - 0 IMPLIES WRITE, 1 IMPLIES READ. 

SUBROUTINE SCROL (FCB, SCROLX, SCROLY, CHANNL, VRTRTC, READ) 

SUBROUTINE READS OR WRITES A SCROLL CONTROL REGISTER. 

DJTEGER FCB{1) , SCROLX, SCROLY, CHANNL, VRTRTC, READ 

AN INTEGER SPECIFYING THE SCROLLING OFFSET 
IN THE X (HORIZONTAL) DIRECTION 
(NOTE THAT ONLY HORI2. SCROLLS IN INCREMENTS OF 
8 PIXELS ARE POSSIBLE- THE 3 LEAST SIG. BITS 
OF SCROLX ARE IGNORED) 

AN INTEGER SPECIFYING THE SCROLLING OFFSET 
IN THE Y (VERTICAL) DIRECTION 

A BIT MAP SELECTING THE CHAN^L(S) TO READ/WRITE: 

1 -> IMAGE 0 

2 -> IMAGE 1 
4 -> IMAGE 2 

ETC 



SCROLX - 

SCROLY - 
CHANNL - 
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16384 -> IMAGE 14 
-32768 -> IMAGE IS (GRAJHICS) 

WHEN WRITING ONLY* THESE CODES HAY BE COMBINED 
TO WRITE THE SAME DATA INTO TWO OR MORE CHANNELS. 
FOR EXAMPLE, CHANNL - -3275B WOULD MEAN CHANNELS 
1, 3. 4 15 

READ - 0 IMPLIES WRITE, 1 IMPLIES READ. 

SUBROUTINE RBL7TN (KB, BUTTON, X, Y) 

ROUTINE TO READ BUTTON WORD AND 
CURSOR POSITION 

SUBROUTINE LTCNT (FCB, MASK, COLOR, VRTRX, RSAD) 

SUBROUTINE TO READ OR WRITE THE LUT MASK(S) 

INTEGER FCB(l), MASK, COLOR, VRTRTC, READ 

MASX - AN INTEGER WHOSE BIT MAP DETERMINES 

WHICH LOOK UP TABLES ARE ENABLED AMD DISABLED 

LSB - 1 — > ENABLE OTH MPtORY 

...ETC. 

COLOR - A CODE INDICATING WHICH LUT MASK TO READ/WRITE: 

1 - BLUE 

2 - GREEN 
4 - RED 

7 - RED+GREEN+GLUE 

READ - 0 IMPLIES WRITE, I IMPLIES READ 

SUBROUTINE LUT (FOB, MAP, COLOR, CHANNL, VRTRTC, READ) 

SUBROUTINE TO READ/WRITE AN ENTIRE LOOK-UP TABLE (LUT) 

INTEGER FCB(l), MAP(2S6) , COLOR, CHANNL, VRTRTC, READ 

MAP - A 256 WORD ARRAY TO RECEIVE/CONTAIN THE LUT CONTENTS 
COLOR - A CODE INDICATING WHICH LUT TO READ/WRITE: 

1 -> BLUE 

2 -> GREEN 
: 4 -> RED 

WHEN WRITING ONLY, THESE CODES MAY BE 
COMBINED TO WRITE THE SAME DATA INTO TWO 
OR THREE LOT'S. FOR EXAMPLE, COLOP-5 WOULD 
WRITE BOTH THE BLUE AND RED LOT'S. 
CHANNL - A BIT MAP SELECTING THE CHANNEL(S) TO READ/WRITE: 

1 -> IMAGE 0 

2 ~> IMAGE 1 
4 -> IMAGE 2 

ETC 

16384 -> IMAGE 14 
-32768 -> IMAGE IS (GRAB* ICS) 

WHEN WRITING ONLY, THESE CODES MAY BE COMBINED 
TO WRITE THE SAME DATA INTO TWO OR MORE CHANNELS. 
FOR EXAMPLE, CHANNL - -32758 WOULD MEAN CHANNELS 
1, 3, 4 15. . 
READ - 0 IMPLIES WRITE, I IMPLIES READ. 

FORTHflN IU-PLUS U02-51 tt- 42 19 20-flJG-80 FflGC I 



MfWCl. FTN /TR: ALAR 

0001 tubrowtlno surkUbuf f ,nonl In, I Insl.nowl, Ichon, Itflr, IDEST) 

C MRRK1 Is o specie) -purposs, un-gonsrol subroutine, to 

C norfc a 512-by-MJI.IN toe t Ion of Jaogo In two charm* Is. 

C URRIRBLE5: 

C buff- » crotch buff or of 1024 Intogort nsadad by subroutine. 

C I inoi- la tho 1st row or column 

C nowl- It Xhm now 1st row or column 

C 1c Kan- ft tKo rolovant (SOLRCE) charms I «osk 

C Idtr- Is 0 for rowt k 1 for eotuwn* 

C I dost- destination chonnsl ma*k; tf Misting or 0, dofaults to «ICHRN. 
o DEGEM3WTE CRSE IF JDESWCHflN and NOUHJNE1, thon only 

C on* sot of onss is drown In, to sows a bit ftf tim :4^4/BB 

BBB2 *m*g©r fcbC6>,«M0 l> ( *o<e t>,byl» 

0003 inu»ar buff(1024) 

0004 col I orgchk??. loct ) 

0005 do i n-1,1024 

0006 1 r ,«(n>*-l 

0007 byts*l 

0008 jdtr*idlr 

0009 jdost»ldnt 

0010 tfljdir It 0.or. jdir. gt . 1) jdlrwB 

OBii lf(Md(nu«l tn,B).nft.0) bgts-0 • In this application, this condition- 
e ts sufficient to avoid IMITX non-miliipts of B! 

0012 If l jdost sq B) jdost-lchon 

0013 npast*CnuAl ln+31 V32 

0014' lost*(B0dCnunl In, 32) > 

OBIS If Matt oq.B) lott-3? 

001G do 5 n-0. 1 

0017 no(n)-0 

BB1B 6 nl(n>-0 
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BB19 ICOi 

0020 IDWfWS 

0821 IHC-1 

BB22 iftlinol.gt.newl) go to 20 

0023 lpa«npoM 

0B24 tend-i 

QB25 Inc— 1 IHuot f I ip orcter to ovoid eorly ovar-trttoo of port* perhopi 
C Ineedod In loior chunht. 

0026 20 do 30 1*1 go, I ond, 1 no 

0027 nuor-32 

0B2B lf< I. oq. npo»« > mmH ect 

0029 nl<l-jd*r)-Mf»l*<»-lW32 

0830 Ko(l-jdir>-newt*tl-l»32 

0031 col I t«ope<fcb,buff ,MlC0>,«lU > l 612«rU1 i jdtr, 1chon, 1, 1, 1, byte, 0, 0, B, B > 

0032 If ( jdaot.no, tchon/or.ft&til. no. I tnel) col I laoge 

1 <fcb.buff t xo(0) l »o(J.),512<nri l jdtr,j(loit, 1.1,1. byti, 0,0,0,0) 

0033 30 eontlnuo 
0834 rotum 
0036 end 

FCRTRflN W-fUS C0a-Sl 12i42tl9 20-AJC-00 FACE 2 

MPRKl.rfN ^TR:flU»« 

moowi sectigtc 



MME* IftC 

1 $C0K1 

2 BPDATn 

3 ftXDflTR 



size 

0010G2 201 

008014 6 

000120 40 

000054 22 

000004 2 



ATTRIBUTES 

RW,I,COrl,LCL 
f*4, D.CCh.LCL 
K>*. D,COh,LCL 
M.D.COh.lXL 
NH,D,COH,LCL 



ENIRY POINTS 

NW TYPE ADCRES5 NflTC TYPE A0DRE55 MR* TYPE MXRESS NflTC TYPE ADDRESS NRTC TYPE ADORES 
NflflKl 1-000000 



HflTC 


TYPE 


ADDRESS 


Hfirc 


TYPE . ADDRESS 


NRHE TYPE 


AlBREStt NflfC 


TYPE ADDF 


CSS NAHX 


BYTE 


1*2 


4-080824 


1 


1*2 4-08B060 


J ACT 1*2 


4^080026 ICMflW 


i«2 r-a 


H01ZB ICEST 


IDlft 


1*2 


F-000B14o 


IDC 


I«2 4-000044 


ICO 1*2 


4-000042 IMC 


1*2 4-0C 


JG04S JOEST 


JOIR 


1*2 


4-G0©kU2 


LAST 


1*2 4-080840 


Lirci 1«2 


F -000006* N 


1*2 4-01 


loaaa ma 


rwes 


1*2 




MM 


1*2 4-OQB052 


NUHLIN 1*2 


F-O80OB4* 







TYPE 



x«2 r- 



ARRAYS 



NRTC 


TYPE 


ABUHfcSS 


SI2E 


DItCHSIONS 


BUTT 


1*2 


F-000B02* 


808014 ^fi 


(1B24> 


rci 


1*2 






(6) 


XI 


1*2 


4-OMB14 


0BBBB4 2 


CB: 1) 


xo 


1*2 


4400020 


OBB0O4 2 


<& 11 




FUCTlOhS AND SUBRCUTlrCS mtKBCE D 
AAQCHC MAX 



TOTAL SPACE ALLOCATED - 001276 361 
HO FFF WSTWJCTlGre GENERATED 

OPl: AffoXl , WRKl/TOSP-rtWl/1.1 ■ 6 

POmWN IV-PUJB wBWl 12= 42i 48 

I TR: ALL4R 

suBROunrc renw buff, icclor, idest, hot, bypifh, ix, iy ) 

FEEDM2 feed* color I COLOR (R4,G2,B1> to channel ICEST, offsetting tho 
looge CIMftTEVCR Its origin) fay I X ond 1Y. (MODIFIED &V23S79 to «ork 
for ANY Ix, ly by using IPKOTT tn TOBCK for x-offeett not dlvltlblo 
by 8.) 

—to potch tho o1ngle-«1xel In » occur ocu, clolnod 6 nontho ago, 

C IrXOTT In feedback leave* several block eoluens In tho 

leftmost esuen of tho destination, which eon bo 
dovootattng; > 

FEE0M2 uooo HFT suppl tod to klugs tn thooo fow coluene, 
mi th 2 collo to IHttE. (l/StO) 

The 2 IS scroll conventions epply to this coll. That to, 
tX» ocroll* on 1*090 to tho LETT, ond XYHJ scrolls UPWARD. Tho 
operation Mould produco Interesting but noraol ly undoolroblo rooulto 
C if X0E5T chonnol contrtbutod *o 1CCL0R, boc ouoo tho ocroHod ZCOLOR 

C Inoao «oy bo distorted during foodbock tn TrrqT. To ovoid ouch problem, 
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me 
flan 

0812 
•013 
9014 
00XS 

BB16 

aei7 

BB1B 

eeis 



9024 



•tort en byte boundary. 



C channel ITOf? con ba fad reaul ta to «eed on to 10CST Pjty 

C com of o chonnol contributing to tto "enrolled •■If requires on ITDf? 

C ehonnel be available. If ITDf* Is not needed, eet It to -I. 

C —Tor now, lft-5CRCLLED OWCS CM.Y eon contribute to 

C ICCLOR Generalising Mould aseertafn currant eerolle froe oil 

C contributing ehonnel » f and Individually update and reeet each one. 

C VWini le • to uee or X to bypass the Input function an fir y. 

C Note CaVS^79> thot ong col I to feed b oc* o color to which the 

C digit tser contributes sust Include on ITDF ehonnel, el nee the 

C digitizer "ehonnel • eon not be scrolled PffJ the original daelgn 

C of •eroding the destination Inversely foils because It does NOT 

C affect feedback* 

C BUT aval be tB-jf*odCl»,0)l 9512 bytes long, end start en m «ord boundary. 
XnTCGCR »YPin%rCBt6> > OfTRlB 
Integer buff(2SE) <au«t I 

HLAil-ITOf 

inntu .LT.fl) mix-ncsT 

CPU. LTOfTC rXB, CKTWIB, XCOLQR, 1 ) 
e* type •,'cntrlb-' .cntrtb 

ip«off-0 

ra}dlli,G) 
lf(neq.0) go to 20 
U/0MQ 

lf(>.lt. le) j*-j*«0 ini0CK offset oust be rlghtevjrd (of feet t vol y< I) 
Ipxof f- jjr-la 

20 ifOteep.tt fl) CPU. SOWLCFCB, j*,IY,OfmiB,B,0> 

au nacxc ra, icclor, 2»ohmi, -i f 0it>ira, 0, «,•) 

IfC lpKoff.eq.01 go to 25 I no "correction" needed to fill In left edge, 
col I inogel f cb, buf ff , S12- lp»ef f , 0, 5I2*lp«of f , X, 2»*nu»l a -X, 1, 1,0, 0, 0, 0, X ) 

cnx nsoct res, icolor, 2**m*u, -x, 0vpifm, tp*ef f ,0,0) 

col I (i»ga( f cb, buff, 0 ( 0,S12*lpoff, X,2»»nunX,-l, 1, 1, 0, 0, 0,0,0) 
2S IfCltemp go.0> go to 39 

CfiLL 9C9CUrC9, 0,0,0^X0,0,0) 

go to X00 
30 DO S >1, 2SB 
B bvff<JW-I " 

CPU. LTCKTC fXB, MflSK, 2*»< 2-IDEST >, 0, 1 > f«»od current W8K for XttST eoler 

CPU. LUT( TCB, buf f , ?SS(2-IDtCT), ZttlTDf 5 , 9,0) ILood linear HIT for HBOC. 

CALL LTCMTrFXB,2eeXTDe?,ZeS(2-IX5T) v B,B) 

cell acrollfcb, jm, ly,ZS«iteBp,e,Bl 

CPU. FTBOU FCB. 2*»( 2-IOEST ), 2UIDEST, -X. 1,0,0, 0> 

coll scroll feb,0,0,2Mlto«p,0,fl> 

CPU. LTOKTt FCB, HflS(, 2M 2-IDEST >, 9, 9 ) IRsetef-e color to previews etote. 



rCPTWH IU-PUB UK-SI 



PRQCrWI SECTIONS 



X2;42--49 2aVflUG-49 



PKJE 2 



MD 


1 NPIC 


SI2C 




1 


tcoccx 


09X442 


401 


2 




0090X4 


6 


3 


91 DATA 


0903GS ' 


123 


4 


9UPAS 




13 


S 


9TD9>S 




1 



m 1K10UICS 

nHI,COH,LCL 
RM,D,CQN,IXL 
9H0,CON,iXU 
PM,D,COH.UL 
PJi,0,COH,LCL 



HPJfX TYPE 



HPTC TVPE fUJCSB . MVC TVFC PXTVCS5 NPJC TVFE — """U^ 

bvpifh 192 r-«B00X2a ofran 102 4-0000x4 . icolor i«2 

ITDf* 192 F-0000109 IX 192 r-0B00X40 IY 

n ya i iuiii 4 max i«2 4-000030 rUU 1*2 



HPJC TVPC M0CS3 SIZE OirtJCIOMB 

200 ! (2S6> 
B (B> 




LABELS 



'LABEL fCORCSB LABEL 



rUCTIOMB Pff) WKUTVC3 WIMJfOil 

roBOc XHPxe LTorr uxr sow. 
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60 



WUTIC 
FREE2C 
EXIT ».* 
CKES 
DATA 



NORMAL 



-Ukcs m character string conundlng a trcnsfor of 512x512 

taag« separations between disk and refresh Mory. 
-wits specified nunber of 60ths of a second: . 
-pauses to allow examination of contents of specified channel, 
-and processing. 

-fill an entire inage plane or planes with ones, 
-initial ixa an array with a e.ivan.alsfcam»eric literal, 
-pause and weit several seconds; report back if there is 

Input during that tlx*. 
-nonnaUz** all functional tables In the systesu 



APPENDIX II 



A preferred color masking stage 58 of FIG. 3 per- 
forms linear transformations of all three sets of proc- 
essed-image information from the image processors 20, 
22 and 24. A first operation calculates the average of the 
combined outputs from the three processors 20, 22 and 
24. With most images this average has an approximately 
uniform distribution of values from (0) to (255). 

A second operation, performed in parallel with the 
first, calculates the difference between, the outputs of 
the information processors 20 and 22, which process the 
long wavelength image information and the middle 
wavelength information, respectively. The resultant 
color difference between the two outputs is represented 
on a scale of (0) to (255). At a given pixel, all colors with 
equal output from processors 20 and 22 will have a vlue 
of (128) on this scale. The difference value at most 
pixels in the image mils in the vicinity of this middle 
value, i.e. (128). Only the most saturated dolors ap- 
proach the extreme values of (0) to (255). In fact, if the 
color detecting system 14 has overlap in its spectral 
sensitivity functions it will cause the total range of dif- 
ference values to be limited to values higher than (0) 
and lower than (255). Based on the range of difference 
values found in a variety of typical images, one can 
expand the limited range found in the particular hard- 
ware system to fill the range of potential color differ- 
ences. This can be implemented by taking the range of 
values determined in taking the long wavelength minus 
middle wavelength difference, in this case at difference 
values from (SO) to (175), and linearly expanding that 
distribution to values that range from (0) to (255); 

A third operation of this color masking stage 58, 
performed in parallel with the first two, is the combina- 
tion of half of the long-wavelength information from 
processor 20 plus half of the middle-wavelength infor- 
mation from processor 22, minus the short-wavelength 
information from processor 24. The resultant represents 
the color differences between two other color bands in 



the color space. As in the second operation, the charac- 
15 teristic range of values associated with the particular 
system can be linearly expanded to fill the range of 
potential color differences. 

After this expansion of the color difference proper- 
ties, the color masking stage recombines the expanded 
20 transformations of the image by computing inverse 
transforms of the original transforms. This produces a 
color-enhanced image that is sent to the exposure con- 
trol stage 60. 

The initial transformation and the color expansion 
25 described above are fully detailed by the following 
listing of a program termed ZOWIE and the data file it 
requires, termed ZOWIE.DAT. The listing and the 
data file are in the same language and for the same 
equipment as described for Appendix I. 

30 

" [ 0.33 0.33 GL33] R L " 

[ 0.50 -asoaoo] x g = ei -ins 

[-0.23 ~0l23 OlSO] B C2 -I27J 

33 After placing L, CI, and C2 into the three memories, 
ZOWIE then expands CI and C2 by the amount speci- 
fied in ZOWIE.DAT. The inverse transform proceeds 
in a similar manner. 
Beginning with L, as is, and the two expanded color 

40 difference channels, each minus 127.5, the mathematical 
inverse of the above matrix is multiplicatively applied: 



45 



[1.00 1.00 -0.671 
[1.00 -1.00 -0.671 
[1.00 0.00 1-33] 



In performing this second transformation, the only 
new requirement concerns results more extreme than 
50 the storage range. (0) to (225), which can occur because 
of the expansion. Such values are replaced with the 
appropriate limit, i.e. either (0) or (255). 



FORTRAN 1V-PUB 


W2-51 10:41:00 14-AIG-60 


zowie. rm 


/TR:ALL/V« 


oodi 




PROGRAM ZOWIE 


0002 




INTEGER FCB(6) , BUFFER (0:1023) 


0003 




INTEGER BUTUJM (0:255). BUTWC (0:255) , BU?BWY (0:255) 


0004 




INTEGER LR,HIR,UXn\KIOUT 


0005 




OPQi(UNIT-l, H^M>•Ull ^ 4l20OT.rAT^TWE- , 01J)^RE«X3NLY) 


0006 


1000 


FDRMAT(2I$) 


0007 




READd r 10C0) ,LR,HIR, LOUT, HlOm 


000B 




DO 13 W>,IR 


0009 


13 


BUFUM(I)»L0Ur 


0010 




DO 14 MUR # 255 


0011 


14 


BU7LUM(I)-HIOUT 


0012 




WNC«FlOAT(HICVMj0Ur)/rL0AT(HIR-LR) 


0013 




DO 15 I*LR,HIR 


0014 


15 




0015 




READ f 1,1000) ,lA r HXR,L0OTtHI0Lrr 


0016 




DO 213 I-O.LR 
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0017 213 BUFRMCm«LCX/r 

0018 DO 214 I=HIR,255 

0019 214 BUFFWG(I)-HKXrr 

0020 XIN>FLC*T(HICX7r-L0UT)/TL0Vr{HIR-LR) 
002) DO 215 I*LR,HIR 

0022 215 BUFT^(I)»NOT{FtOAT(L0Ur)+PL0AT{I-IJl)*XINC) 

0023 READ (1, 1000 ),LR,HIR, LOUT, HJOVT 

0024 DO 313 1*),LR 

0025 313 BUF9MY(I)»LOUT 

0026 DO 314 1-HIR,255 

0027 314 BUFBMY(I)«HIOUT 

0026 XINOFLOAT (HIOUT-LOUT) /FLOAT (HIR-LB) 

0029 DO 315 I«LR,HXR 

0030 315 BUFBMy(I)^IMT(IT«T(U)Ur)+FL0AT(I-LR)*XINO 
C 

c 

C TRANSFORM IMAGE TO LWINANCE-CHROMINANCEX3^INANCE SPACE 

C 

C 

0031 CALL NORMAL (K2J, BUFFER, 3,0) 

0032 CALL LTCNT[rCB,7,7,0,0) 
C 

C THIS PROGRAM SHOULD TAKE AN IMAGE IN REFRESH WITH RED (R), 

C GREEN (G) , AND BLUE (B) SEPARATIONS IN CHANNELS 0, 1,2, RESPECTIVELY, 

C AND REPLACE IT BY A NEW IMAGE IN WHICH CHANNEL 0 WILL CONTAIN 

C "LUMINANCE" (L), DEFINED AS : 

C 

C L» <1/3)*<R*G*B) 

C 

C CHANNEL 1 WILL CONTAIN THE COLOR DIFFERENCE RED MINUS GREEN 

C SCALES TO THE RANGE 0 TO 255: 

C 

C Cl*(l/2)«<25S4ft-G) 

C 

C CHANNEL 2 WILL CONTAIN THE COLOR DIFFERENCE BLUE MINUS YELLOW 

C SCALED TO THE RANGE 0 TO 255: 

C 

C C2M1/4)*(510+2B-(R4C)) 

C 

C 

C THE PROCEDURE WILL NOT REQUIRE ANY MOVING OR STORING OF IMAGES, JUST 

C USE OF LOOK UP TABLES, CONSTANT REGISTER, IFM, AND FEEDBACK. 



C 



C 
C 

C STEP 1. REPLACE CHANNEL 0 BY L 

C 

0033 DO 10 1-0,255 

0034 10 BUFFER (I) -I 

0035 CALL LUT(FCB,BUFFER,4,7,0,0) 

0036 DO 20 1-0,765 

0037 20 BUF7ER(I)^INT(FLOAT(I)/3.) 
0036 CALL IFM (FCB, BUFFER, 0,766,0, 0,0) 
0039 CALL FDBCK(FCB, 4, 1,255,0,0,0,0) 



C 

C STEP 2. REPLACE CHANNEL 1 BY CI 
C 

C NOTE: SINCE CHANNEL 0 HAS BEEN REPLACED BY L, WE USE A DIFFERENT FORMULA 

C FOR COMPUTING CI: 

C 

C Cl«(l/2)* (255+3L-2G-B) 
C 

C NOTE: THE LOOK UP TABLE FOR THE IMAGE WITH THE MAXIMUM SCALED RANGE 

C (NAMELY (3/2)*L) WILL BE SCALED TO USE AS MUCH OF ITS RANGE AS 

C POSSIBLE. THE OTHER TABLES WILL BE SCALED APPROPRIATELY. THE 

C MULTIPLICATIVE SCALE FACTOR MUST, OF COURSE, BE THE SAME FOR ALL 

C THREE LOOK UP TABLES. THE VARIOUS ADDITIVE OFFSETS (USED TO HAKE 

C THE LOWEST OUTPUT BE MAPPED TO THE BEGINNING OF THE LOOK UP TABLE 

C OUTPUT, -256) WILL BE COMPENSATED FOR WITH THE CONSTANT REGISTER. 

C THIS REGISTER WILL ALSO BE USED TO HANDLE THE 255 OVERALL ADDITIVE 

C COETANT. TOE WHOLE THING WILL THEN BE FED BACK TO THE 0 TO 255 

C RANGE OF REFRESH THROUGH THE INPUT FUNCTION MEMORY (IFK) . 
C 

C NOTE: ANALOGOUSLY FOR C2. 
C 

c . , 

C 

C IN LINE WITH THE ABOVE, WE REWRITE THE FORMULA FOR CI: 

C 

C Cl»(V4)*[2L*(-4/3)G+(-2/3)B+170> 



C 

0040 DO 30 IK), 255 

0041 30 BUFFER (I) - 2*1 - 256 

0042 CALL LUT(FCB, BUFFER, 2,1.0,0) 
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0043 
0044 
0045 
0046 
0047 
0048 
0049 
0050 
0051 
0052 
0053 



0054 
005S 
0056 
0057 
0058 
0059 
0060 
0061 
0062 
0063 
0064 
0065 
0066 



0067 
0068 
0069 
0070 
0071 
0072 
0073 
0074 



C 

c- 

c 

c 

c 

c 

c 

c 

c 

c 

c 

c 



63 

DO 40 1-0,255 
40 BUFFER(I)^iNT(-4.*FlJ0AT(I)/3.) 
CALL LUr(FCB,BUFFER,2,2,0,0} 
DO 50 1-0,255 
50 BUFFER(I)»«rNT(-2.*FLOAT(I)/3.) 
CALL LUT(FCB,BUrTER,2,4,O,0J 
CALL OONST(FC8 # 0 # 428,0,0,0) 
DO 60 1^,340 
60 BimR(I)^INT(3.*FlJ0AT(I)/4.) 
CALL IIH(FCB,BUmil,O t 3ll r O r O l O) 
CALL FEBCX(FCB,2 # 2 r 255,0,0,0,0) 
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90 



64 



+ 84 



86 



STEP 3. REPLACE CHANNEL 2 BY C2 

AS FCR CI, ABOVE, HE MUST REWRITE FOWL* PGR C2 US DC THE CUANTTTD2S 
THAT STILL EXIST IN REFRESH: L, CI, B. (CI IS MOT REQUIRED HERE.) 



C2-(V4)*U7D+B-L) 



DO 70 Ml, 255 . 
BUFFER (I) -I 

CALL LUT(FCB, BUFFER, 1,4,0,0) 
DO 80 1«0,255 
BUFFER (I )*-! 

CALL UrT(FCB, BUFFER, 1, 1,0,0) 
CALL LTCNT(FCB,5,l r 0 ( 0) 
CALL CCKST(FC8 P 170,0,0,0,0) 
DO 90 1-0,340 

BUFFER{I)*NIHT(3.*FLOAT(I)/«.) 
CALL IfM(FCB,BUFFER,0,341 f O,0,0) 
CALL FDBCK(FCB,1,4,255,0,0,0,0) 
CALL NORMAL (FCB, BUFFER, 3,0) 



NOW CHANGE SLOPE OF LUMINANCE CHANNEL 

CALL LUT(FCB,BUFUW,4,1,0 # 0) 
CALL FXBCK(FCB, 4,1,255,1,0,0,0) 
CALL LUT(FCB,BUFRMG,2,2,0,0) 
CALL FTJBCK(FCB, 2, 2,255,1,0,0,0) 
CALL LUT(KB,BUFBMy,l,4,0,0) 
CALL FEBCK(FCB,1, 4,255,1,0,0,0) 
STOP 'ZGWIE' 



0 

0 
80 

0 
60 

0 



JSWIE.DAT file that specifies magnitude of color masking trans fonnatio 
(for program 20WIE) 



255 
255 
175 
255 
175 
255 



LUMINANCE CHANNEL IN 
RED-GREEN CHANNEL IN 



OUT 



OUT 



BLUE-YELLOW CHANNEL EN 



FORTRAN IV-PLUS V02-51 
ZOWIE.FTN /TR:ALL/WR 

PROGRAM SECTIONS 



10:41:00 



OUT 

14-AUC-eO 



(LOW, HIGH) 

(LOW, HIGH) 

(LOW, HIGH) 

(LOW, HIGH) 

(LOW, HIGH) 

(LOW, HIGH) 



(215) 
(215) 
(215) 
(215) 
(215) 
(215) 



NUMBER 



NAME 


SIZE 


ATTRIBUTES 


SCODE1 


003030 


780 


RW,I,CON,LCL 


SPDATA 


000110 


36 


RW,D,CON,LCL 


SI DATA 


000542 


177 


RW,D,CON,LCL 


SVARS 


007032 


1805 


RW,D,CON,LCL 


STEMPS 


000004 


2 


RW,D,CON,LCL 



VARIABLES 
NAME TYPE ADDRESS 



HIOUT 1*2 
LR 1*2 



ARRAYS 



NAME TYPE ADDRESS 



4-007022 
4-007014 



BIR 
XINC 



1*2 
R*4 



4-007016 
4-007026 



NAME 
I 



TYPE ADDRESS 
1*2 4-O07024 



NAME 
LOUT 



TYPE ADORE 
1*2 4-007! 



NAME TYPE ADDRESS 



SIZE 



B UFBMY 1*2 
BUFFER 1*2 
BUFLUM 1*2 
BUFRMG 1*2 
FCB 1*2 



4-006014 001000 256 

4-000014 004000 1024 

4-004014 O01OO0 256 

4-O05014 001000 256 

4-000000 000014 6 



DIMENSIONS 

(0:255) 

(0:1023) 

(0:255) 

(0:255) 

(6) 
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LABEL 


AECRESS 


LABEL 


AECRESS 


LABEL 


AECRESS 


LABEL AECRESS 


10 


** 


13 


*+ 


14 


** - 


15 ** 


20 


** 


30 


** 


40 


** 


50 ** 


GO 


#* 


70 


** 


80 


•* 


90 ♦* 


213 


#* 


214 


** 


215 


** 


313 ** 


314 


•* 


315 


#* 


1X0" 


3-000000 





FWCTIOJG AND SUBROUTIKES REFERENCED 
CGNST FCBCK IFM LTCNT LU7 NORMAL OPENS 

TOTAL SPACE ALLOCATED * 012740 28O0 
, K3WIE/N0SM0WIE/LI :6 

APPENDIX III 

A preferred exposure control stage 60 of FIG. 3 uses 
the output from the color masking stage 58 and com- 
putes an optimal use of the characteristic dynamic 20 
ranges of each color component of the color display, in 
this case Polaroid SX-70 Time Zero brand instant Film. 
Exposure control functions that map the numerical 
output of the FIG.3 system into those which produce 
the desired representation on this film are calculated. 23 
These transformations are small because of the power- 
ful improvements already incorporated in the image 
processing stages 20, 22 and 24, and in the color mask- 
ing stage 58. This final exposure control stage is thus 
designed to fit the limited dynamic range of outputs 30 
from processors 20, 22 and 24 more closely to the par- 
ticular dynamic range of the display device, e.g. the 
photographic film being used. The numerical transfor- 
mation performed in one control stage 60 for the above- 
noted film is shown in the plot of FIG. 13. The transfor- 35 
mation is identical for the red, green, and blue channels. 

Having described the invention, what is claimed as 
new and secured by Letters Patent is set forth in the 
appended claims. 

1. Apparatus for producing an image of a subject 40 
which comprises 

A. means for detecting radiance ratios between differ- 
ent areas of said subject and producing a first light- 
ness-determining quantity in response to each such 
ratio, 45 

B. means for effecting said ratio detection for each 
area of said subject a multiple number of times with 
other areas of said subject which are at different 
locations on said subject relative to that area, 

C. means for combining each first lightness-determin- 50 
ing quantity with a second lightness-determining 
quantity associated with one area in that ratio and 
replacing the second lightness-determining quan- 
tity associated with another area in that ratio in 
response thereto, and 55 

D. means for producing an image of the subject in 
which the lightness of the respective image areas is 
determined by the last replacement values of said 
second lightness-determining quantities. 

2. Image processing apparatus for determining a field 
of accumulating measures of image lightness in response 
to information identifying optical radiance associated 
with arrayed sections of an image field, said apparatus 
having the improvement comprising 65 

A. means for sequentially determining a comparative 
measure of the radiance information for each seg- 
mental area of said image field relative to said in- 



Snznt 



formation for each of plural other segmental areas, 
said means 

(i) providing a new intermediate value of each such 
measure in response to the product of a ratio 
function of the radiance information associated 
with each first-named segmental area and with 
each second-named segmental area and of a like 
measure previously determined for the second- 
named segmental area, and 

(ii) determining a sequentially new value of each 
said measure in response to a selectively 
weighted averaging of said new intermediate 
value and a like measure previously determined 
for said first-named segmental area, and 

B. means for the prior measure for each first-named 
segmental area in response to said newly-deter- 
mined value, thereby to determine each measure in 
the field thereof in response to an accumulating 
succession of said measures. 

3. Image processing apparatus according to claim 2 
further characterized in that said measure-determining 
means includes means for determining different ones of 
each said plurality of measures for first-named and se- 
cond-named areas that correspond to spatially different 
sections of said image field, where said spatial difference 
includes at least a difference in size of or in separation 
between first-named and second-named areas for which 
that measure is being determined. 

4. Image processing apparatus for determining a field 
of accumulating measures of image lightness in response 
to information identifying optical radiance associated 
with an image field, said apparatus having the improve- 
ment comprising 

A. means for sequentially determining a comparative 
measure of the radiance information for each seg- 
mental area of said image field relative to said in- 
formation for each of plural other segmental areas 
of that field, said means 

(i) providing a new intermediate value of each such 
comparative measure in response to the product 
of a ratio function of the radiance information 
associated with each first-named segmental area 
and with each second-named segmental area and 
of a like measure previously determined for the 
second-named segmental area, and further pro- 
viding each such intermediate value with refer- 
ence to a selected condition of said product, and 

(ii) determining a sequentially new value of each 
said comparative measure in response to a selec- 
tively weighted averaging of said new intermedi- 
ate value and a like measure previously deter- 
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20 



25 



mined for said first-named segmental area, and 
B. means for replacing the previously determined 
measure for each first-named segmental area in 
response to said sequentially-determined new 
value, thereby to determine each measure in the 5 
field in response to an accumulating succession of 
said comparative measures. 

5. Image processing apparatus according to claim 4 
further characterized in that said measure determining 
means includes means for determining said measure for 10 
each first-named area relative to each of a set of second- 
named other areas, where said set includes areas at 
selected different image-field locations relative to said 
first-named area. 

6. Image processing apparatus according to claim 4 15 
further characterized in that said measure determining 
means includes means for effecting a determination of 
said measure for each of a selected plurality of areas 
prior to effecting a further such determination for an 
area of that plurality. 

v 7. Image processing apparatus for determining infor- 
mation corresponding to image lightness in response to 
radiance-identifying information for a selected image 
field* said apparatus having the improvement compris- 
ing 

A. means for representing the radiance-identifying 
information for each of selected segmental areas of 
the viewing field, 

B. means for determining a selected comparison mea- 
sure between said identifying information for each 
segmental area and said information for another 
segmental area, and for determining therefrom and 
from a previously-determined lightness-identifying 
quantity for each latter segmental area a newly- 3$ 
determined lightness-identifying quantity for each 
former segmental area, 

C. means for effecting a selected multiple of said 
determinations sequentially and between segmental 
areas that correspond to differently-spaced loca- ^ 
tions in said field of view, and 

D. means for producing said lightness-information for 
said image field in response to said multiple deter- 
minations. 

8. Image processing apparatus according to claim 7 4J 
having the further improvement in which said means 
for effecting said determinations sequentially includes 
means for applying each newly-determined quantity of 
one determination as a previously-determined quantity 

in a subsequent determination. „ 

9. Image processing apparatus according to claim 7 
having the further improvement in which said means 
for effecting said determinations with differently- 
spaced locations includes means for ordering said deter- 
minations according to the magnitude of the spacing 
between locations. 

10. Image processing apparatus according to claim 9 
having the further improvement in which said means 
for ordering said determinations effects said ordering 
with determinations between areas of largest spacing 
being performed first. 

11. Image processing apparatus according to claim 7 
having the further improvement in which said means 
for determining includes means for operating on a set of 
said identifying information that is responsive to said 
selected image field to effect one said determination for 
each segmental area of the image field prior to effecting 
a further determination for any such segmental area. 

12. Image processing apparatus according to claim 7 
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having the further improvement in which said means 
for effecting multiple determinations is further arranged 
to produce for each segmental area a lightness-identify- 
ing quantity that is responsive to radiance-identifying 
information for substantially every other segmental area 
of the image field/ 

13. Image processing apparatus for determining infor- 
mation corresponding to image lightness in response to 
radiance-identifying information for a selected image 
field, said apparatus having the improvement compris- 
ing 

A. means for representing said radiance-identifying 
information for each of selected segmental areas of 
the viewing field, 

B. means for determining a selected comparison mea- 
sure between said identifying information for each 
segmental area and said information for another 
segmental area, and for determining therefrom and 
from a previously-determined lightness-identifying 
quantity for each latter segmental area a newly- 
determined lightness-identifying quantity for each 
former segmental area, said means for detennining 
including means for effecting a determination of 
said measure for each of a selected plurality of 
areas prior to effecting a further such determina- 
tion for an area of that plurality, 

C. means for effecting a selected multiple of said 
determinations for said plurality of areas sequen- 
tially, different ones of said sequential determina- 
tions being between segmental areas having a spa- 
tial parameter different from that of the areas of 
other such determinations, and for applying each 
newly-determined quantity of one determination as 
a previously-determined quantity- in a subsequent 
determination, and further including means for 
ordering said determinations according to the mag- 
nitude of said spatial parameter, and 

D. means for producing said lightness-information for 
said image field in response to said multiple deter- 
minations. 

14. lightness-imaging apparatus having means for 
providing information identifying optical radiance asso- 
ciated with arrayed sections of a selected image field, 
said apparatus further comprising 

A. means for selectively grouping segmental areas of 
said image field a selected number of times, differ- 
ent ones of at least some of said groupings involv- 
ing areas haying at least one spatial parameter dif- 
ferent from other groupings of areas, 

B. means for providing, for each grouping of segmen- 
tal area, at least one measure of visually significant 
transition in said radiance information between 
areas of that grouping, said measures being with 
reference to a selected lightness condition, and 

C. means for determining image lightness for each 
arrayed section of the image field in response to a 
plurality of said measures, at least some of which 
are provided for groupings which differ from one 
another in at least one spatial parameter. 

15. Imaging apparatus according to claim 14 in which 
each segmental area has a geometrical center, and in 
which said means for grouping provides different ones 
of at least some of said groupings among areas having a 
different spacing parameter between the geometrical 
centers thereof 

. 16. Imaging apparatus according to claim 14 in which 
each segmental area has a geometrical center, and in 
which said means for grouping provides different ones 
of at least some of said groupings among areas having a 
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different spacing dimension between the geometrical 
centers thereof. 

17. Imaging apparatus according to claim 14 in which 
each segmental area has a geometrical center, and in 
which said means for grouping provides different ones 
of at least some of said groupings among areas having a 
different spacing direction between the geometrical 
centers thereof. 

18. Imaging apparatus according to claim 14 in which 
said means for grouping provides different ones of at 
least some of said groupings among areas having differ-, 
ent separations between the edges thereof. 

19. Imaging apparatus according to claim 14 in which 
said means for grouping provides different ones of at 
least some of said groupings among segmental areas 15 
having a size different from the sizes of segmental areas 
in other groupings. 

20. Imaging apparatus according to claim 14 in which 
said means for grouping provides at least a first of said 
groupings with areas of uniform size and provides dif- 20 
ferent ones of such groupings among areas having dif- 
ferent separations in terms of at least one spatial parame- 
ter selected from the parameters of distance and of 
direction. 

21. Imaging apparatus according to claim 14 25 

A. further comprising means for assigning each seg- 
mental area an initializing value of said measure. 

B. in which said measure-providing means includes 
means for providing each said measure in response 
to the product of a ratio function of the radiance 30 
information associated with grouped areas and the 
measure already assigned to a first of said grouped 
areas, and 

C. further comprising means for replacing the mea- 
sure assigned to a second of said grouped areas in 35 
response to said product-responsive measure. 

22. Imaging apparatus according to claim 14 further 
including means for resetting said product-responsive 
measure with reference to said selected lightness condi- 
tion. 

23. Imaging apparatus according to claim 21 in which 
said measure-providing means includes means for im- 
posing a threshold on said ratio function. 

24. Imaging apparatus according to claim 21 further 
comprising means for retaining the measure assigned to 45 
said second of said grouped areas, in lieu of said replac- 
ing, for each said second grouped area which is grouped 
with an area located beyond said image field. 

25. Imaging apparatus according to claim 14 in which 
said measure-providing means includes means for reset- 50 
ting at least selected ones of said measures with refer- 
ence to said selected lightness condition. 

26. Imaging apparatus according to claim 14 in which 
said determining means determines image lightness in 
response to an arithmetic averaging function of plural 55 
ones of said measures provided for groupings which 
differ from one another in at least one spatial parameter. 

27. Imaging apparatus according to claim 14 in which 
said measure-providing means includes means for pro- 
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B. in which said measure-providing means includes 
means for providing said sequential measures or- 
dered between groupings of largest spatial parame- 
ter and groupings of smallest parameter. 

29. Imaging apparatus according to claim 14 in which 
said measure-providing means includes 

A. means for sequentially providing different ones of 
said measures of visually-significant transition in 
radiance information for the same segmental area, ' 

B. means for assigning each segmental area an initial- 
izing prior value of said measure, 

C. means for providing an intermediate value of each 
said measure in response to the product of a ratio 
function of the radiance information associated 
with grouped areas and the measure already as- 
signed to a first of said grouped areas, 

D. means for providing each said measure in response 
to a selectively weighted averaging of an interme- 
diate value provided sequentially previously for 
said first of said grouped areas and of the prior 
measure for a second of said grouped areas, and 

E. means for replacing the prior measure for said 
second of said grouped areas in response to said 
averaging, thereby to determine image lightness in 
response to an accumulating succession of said 
measures. 

30. In lightness-imaging apparatus having 

(i) means for providing information identifying opti- 
cal radiance associated with each arrayed section 
of a selected image field, 

(ii) means for selectively pairing segmental areas of 
said image field a selected number of times, each 
said pairing being of segmental areas of identical 
configuration and size, 

(iii) means for providing, for each pairing of segmen- 
tal areas, at least one comparative measure of said 
radiance information at the paired areas, and 

(iv) means for resetting each said measure with refer- 
ence to a selected limit condition, 

40 the improvement comprising means for determining 
image lightness for each arrayed section of the image 
field in response to a plurality of said reset measures, at 
least some of which are provided for pairings which 
differ from one another in at least one spatial parameter. 

31. In imaging apparatus according to claim 30, the 
further improvement 

A. comprising means for assigning each segmental 
area an initializing value of said measure, 

B. in which said measure-providing means includes 
means for providing each said measure in response 
to the product of a ratio function of the radiance 
information associated with paired areas and the 
measure already assigned to a first of said paired 
areas, and 

C. further comprising means for assigning a replace- 
ment value to the measure assigned to a second of 
said paired areas in response to said product- 
responsive measure. 

32. In imaging apparatus according to claim 30, the 



viding at least some said measures in sequence with one 60 further improvement in which said means for pairing 



another and for providing sequentially-successive mea- 
sures in response, at least partially, to a preceding mea- 
sure for an area of a grouping, thereby to determine said 
image lightness in response to an accumulating succes- 
sion of said measures. 
28. Imaging apparatus according to claim 27 
A. in which said means for grouping provides group- 
ings which differ by a magnitude parameter, and 



segmental areas includes means for providing different 
ones of said pairs of said areas with different spacing 
parameters ordered in said sequence from pairings of 
the largest parameter to pairings of the smallest parame- 
65 ter. 

33. In imaging apparatus according to claim 30, the 
further improvement including 
A. memory means arranged for storing said radiance- 
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identifying information, 

B. scroll means arranged with said memory means for 
providing said selective pairings of segmental ar- 
eas, 

C. signal transformation means for providing said 5 
resetting of measures and for providing selectively 
transformed information in said memory means, 
and 

D. adder means arranged with said memory means, 
said scroll means and said transformation means for 10 
providing said comparative measures in response 

to selectively scrolled and transformed information 
in said memory means, and for providing an arith- 
metic averaging of plural reset measures, at least 
some of which are provided for pairings which 15 
differ from one another in at least one spatial pa- 
rameter. 

34. In imaging apparatus according to claim 30, the 
further improvement 

A. in which said means for pairing segmental areas 20 
includes means for providing said number of pairs 
sequentially, 

B. comprising means for assigning each segmental 
area an initializing value of said measure, and 

C. in which said measure-providing means includes 25 

(1) means for providing an intermediate value of 
each said measure in response to the product of a 
ratio function of the radiance information associ- 

: ated with paired areas and the measure already 

assigned to a first area of each pair, 30 

(2) means for providing each said measure in re- 
sponse to a selectively weighted averaging of the 
last previously provided intermediate value for 
said first area of each pair and the last previously 
provided prior measure for a second area of each 35 
pair, and 

(3) means for proving a replacement for the prior 
measure for each second area in response to said 
averaging, thereby to determine image lightness 

in response to an accumulating succession of said 40 
measures. 

35. In imaging apparatus according to claim 34, the 
further improvement in which said measure-providing 
means includes means for providing a unity ratio in 
response to radiance values within a selected measure of 45 
one another. 

36. In imaging apparatus according to claim 34 the 
further improvement in which said measure-providing 
means includes means for producing said measure, for 
each second area which is paired with a first area lo- 50 
cated beyond the image field, in response exclusively to 
the measure already assigned to that second area. 

37. In imaging apparatus according to claim 30, the 
further improvement in which 

A. each segmental area corresponds to a coordinate- 55 
identified location of said image field, and 

B. said means for pairing provides a pairing of each of 
plural second areas with a different first area re- 
moved therefrom by the same coordinate direction 
and spacing. 60 

38. In imaging apparatus according to claim 37, the 
further improvement 

A. in which said means for pairing segmental areas 
includes means for providing said number of pairs 
sequentially, 65 

B. comprising means for assigning each segmental 
area an initializing prior measure and for updating 
each prior measure in response to the measure 
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provided for each sequential pairing, and 
C. comprising means for providing said measure, for 
each second area paired with a first area located 
beyond said image field in said coordinate direc- 
tion, in response only to the prior measure assigned 
to that second area. 

39. Image processing apparatus comprising 

A. first and second signal addder means, 

B. first and second delay means, each arranged to 
apply signals output therefrom to an input of the 
same-numbered adder means, 

C. first and second signal transformation means, each 
arranged to apply signals output therefrom to a 
further input of the same-numbered adder means, 
said first transformation means having a polarity 
inversion function and said second transformation 
means having a reset function and being arranged 
to receive signals output from said first adder 
means, 

D. first memory means arranged to apply signals read 
therefrom to said first transformation means and to 
said first delay means, 

E. second memory means arranged to apply signals 
read therefrom to a further input of said first adder 
means and to said second delay means, 

F. further signal transformation means having a com- 
press function and arranged to receive signals from 
said second added means and to apply signals to an 
input of said second memory means, and 

G. control means for controlling said adder means, 
delay means, transformation means and memory 
means for applying signals to said first adder means 
from said first transformation means and from said 
first delay means and from said second memory 
means with selected relative timing, and to apply 
signals to said second adder means from said sec- 
ond transformation means and from said second 
delay means with selected timing relative to one 
another and relative to said application of signals to 
said first adder means. 

40. Lightness-imaging apparatus having means for 
providing information identifying optical radiance asso- 
ciated with arrayed sections of a selected image field, 
said apparatus further comprising 

A. means for pairing identically configured and sized 
segmental areas of said viewing field differently a 
number of times and for providing a multiple of 
sets of said different pairings, each said set involv- 
ing areas of a size different from other sets, 

B. means for providing, for each pairing of segmental 
areas, a comparative measure of said radiance in- 
formation at the paired areas, 

C means for resetting each said measure with refer- 
ence to a selected limit, and 

D. means for determining image lightness for each 
arrayed section of the image field in response to a 
plurality of said reset measures. 

41. Imaging apparatus according to claim 40 

A. further comprising means for assigning each seg- 
mental area an initializing value of said measure, 

B. in which said measure-providing means includes 

(1) means for providing each said measure in re- 
sponse to the product of a ratio function of the 
radiance information associated with the two 
paired areas and the measure already assigned to 
a first of said paired areas, and 

(2) means for replacing the measure assigned to 
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each second area of a pair in response to said 
product, and 

C. in which said means for determining includes 

(1) means for providing said replaced measures for 
each set of pairings sequentially for different sets 5 
thereof, and 

(2) means for producing an initializing value of said 
measure for all but the sequentially first set of 
pairings in response to the replaced measure 
produced with the last pairing of the sequentially 10 
preceding set thereof. 

42. Imaging apparatus according to claim 40 

A. in which said measure-providing means includes 
means for providing multiple measures of image- 
Meld lightness for said pairings in each set thereof, 15 
and 

B. in which said means for determining includes 
means for arithmetically combining said measures 
from each set of pairings. 

43. Lightness-imaging apparatus having means for 20 
providing information identifying optical radiance asso- 
ciated with each arrayed section of a selected image 
Held, said apparatus further comprising 

A. means for selectively pairing segmental areas of 
said image field a selected number of times, each 25 
said pairing being of segmental areas of identical 
configuration and size, 

B. means for providing, for each pairing of segmental 
areas, at least one measure of transition in said 
radiance information between the paired areas, said 30 
measure conforming to the equation: 

log ip(xy)<=> tog qpfooH log *vV)- *°« 

wnere , ■ 35 
log ip(x,y) is the log of the measure for a first seg- 
mental area at location (x,y) in the image field 
relative to a reference location for a second area 
paired therewith, 
log op(o,o) is the log of the measure previously 40 

assigned to or determined for said second seg- 
. mental area at said reference location (0,0) in the 

image field and paired with said first area, and 
log r(x,y) and log r(o,o) are the logs of the radiance 
information for said first and second paired ar- 45 
eas, respectively, . 
. C. means for resetting each said measure with refer- 
ence to a selected limit and 

D. means for determining image lightness for each 
arrayed section of the image field in response to an 5Q 
arithmetic averaging of a plurality of said reset. 
measures, at least some of which are provided for 
pairings which differ from one another in at least 
one spatial parameter 

44. Lightness-imaging apparatus having means for 55 
providing information identifying optical radiance asso- 
dated with each arrayed section of a selected image 
field, said apparatus further comprising 

A. means for selectively pairing segmental areas of 
said image field a selected number of times, each $n 
said pairing being of segmental areas of identical 
configuration and size, 

B. means for providing, for each pairing of segmental 
areas, at least one measure of transition in said 
radiance information between the paired areas, said 65 
measure conforming to the equation: 

log np(x,y)=* l/2<[log op(x.y)i+ [log afao) + log r 
(x.>)-logf(fto)D 



where 

log np(x,y) is the log of the measure for a first 
segmental area at location (x,y) in the image field 
relative to a reference location for a second area 
paired therewith, 

log op(x,y) is the log of the measure previously 
assigned to or determined for said first area, 

log op(o,o) is the log of the measure previously 
assigned to or determined for said second seg- 
mental area at said reference location (0,0) in the 
image field and paired with said first area, and 

log r(x»y) and log r(o,o) are the logs of the radiance 
information for said first and second paired ar- 
eas, respectively, 

and where each said term flog op(o,o)+ log 
r(x,y)— log r(o,o)] is reset with reference to a 
selected limit. 

45. Imaging apparatus according to claim 44 further 
comprising means for determining image lightness for 
each arrayed section of the image field in response to an 
arithmetic averaging of a plurality of said reset mea- 
sures, at least some of which are provided for pairings 
which differ from one another in at least one spatial 
parameter. 

46. A method for producing an image of a subject 
comprising the steps of 

A. detecting radiance ratios between different areas 
of said subject and producing a first lightness- 
determining quantity in response to each such ra- 
tio, 

B. effecting said ratio detection for each area of said 
subject a multiple number of times with other areas 
of said subject which are at different locations on 
said subject relative to that area, 

C. combining each first lightness-determining quan- 
tity with a second lightness-determining quantity 
associated with one area in that ratio and replacing 
the second lightness-determining quantity associ- 
ated with another area in that ratio in response 
thereto, and 

D. producing an image of the subject in which the 
lightness of the respective image areas is deter- 
mined by the last replacement values of said second 
lightness-determining quantities. 

47. An image-processing method for determining a 
field of accumulating measures of image lightness in 
response to information identifying optical radiance 
associated with an image field, said method having the 
improvement comprising the steps of 

A. sequentially determining a comparative measure 
of the radiance information for each segmental area 
of said image field relative to said information for 
each of plural other segmental areas, said method- 
determining step including 

(i) providing a new intermediate value of each such 
measure in response to the product of a ratio 
function of the radiance information associated 
with each first-named segmental area and with 
each second-named segmental area and of a like 
measure previously determined for the second- 
named segmental area, 

(ii) determining a sequentially new value of each 
said measure in response to a selectively 
weighted averaging of said new intermediate 
value and a like measure previously determined 
for said first-named segmental area, and 

B. updating the previously determined measure for 
each first-named segmental area in response to said 
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sequentially-determined new value, thereby to de- 
termine each measure in the field in response to an 
accumulating succession of said measures. 

48. An image processing method according to claim 
47 further characterized in that said measure-determin- 
ing step includes determining different ones of each said 
plurality of measures for first-named and second-named 
areas that correspond to spatially different sections of 
said image field, where said spatial difference includes 
at least a difference in size of or in separation between 
first-named and second-named areas for which that 
measure is being determined. 

49. An image processing method for determining a 
field of accumulating measures of image lightness in 
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mined lightness-identifying quantity for each for- 
mer segmental area, i 

C. effecting a selected multiple of said computations 
sequentially between segmental areas that corre- 
spond to differently-spaced locations insaid field of 
view, and 

D. producing said lightness-information for said 
image field in response to said multiple determina- 
tions. 

53. An image processing method according to claim 
52 having the further improvement in which said step of 
effecting said determinations sequentially includes ap- 
plying each newly-determined quantity of one determi- 
nation as a previously-determined quantity in a subse- 



response to information identifying optical radiance 15 quent determination, 
associated with an image field, said method having the 54. An image processing method according to claim 
improvement comprising the steps of 52 having the further improvement in which said step of 

A, sequentially determining a comparative measure effecting said determinations with differently-spaced 
of the radiance information for each segmental area locations includes ordering said determinations accord- 
of said image field relative to said information for 20 ing to the magnitude of the spacing between locations, 
each of plural other segmental areas of that field, 55. An image processing method according to claim 
said measure-determination including 52 having the further improvement in which said step of 

(i) providing a new intermediate value of each such determining includes operating on a set of said identity- 
comparative measure in response to the product ing information that is responsive to said selected image 
of a ratio function of the radiance information 25 field to effect one said determination for each segmental 



40 



associated with each first-named segmental area 
and with each second-named segmental area and 
of a like measure previously determined for the 
second-named segmental area, and further pro- 
viding each such intermediate value with refer- 
ence to a selected condition of said product, and 
(ii) determining a sequentially new value of each 
said comparative measure in response to a selec- 
tively weighted averaging of said new intermedi- 
ate value and a like measure previously deter- 35 
mined for said first-named segmental area, and 
B. replacing the previously-determined measure for 
each first-named segmental area in response to said 
sequentially new value, thereby to determine each 
measure in the field thereof in response to an accu- 
mulating succession of said comparative measures. 

50. An image processing method according to claim 
49 further characterized in that said measure-determin- 
ing step includes determining said measure for each 
first-named area relative to each of a set of second- 45 
named other areas, where said set includes areas at 
selected different image-field locations relative to said 
first-named area. 

51. An image processing method according to claim 
49 further characterized in that said measure determin- 50 
ing step includes effecting a determination of said mea- 
sure for each of a selected plurality of areas prior to 
effecting a further such determination for an area of that 
plurality. 

52. An image processing method for determining 55 
information corresponding to image lightness in re- 
sponse to radiance-identifying information for a se- 
lected image field, said method having the improvement 
comprising the steps of 

A. representing said radiance-identifying information 60 
for each of selected segmental areas of the viewing 
field, 

B. determining a selected comparison measure be- 
tween said identifying information for each seg- 
mental area and said information for another seg- 65 
mental area, and determining therefrom and from a 
previously-determined lightness-identifying quan- 
tity for each latter segmental area a newly-deter- 



area of the image field prior to effecting a further deter- 
mination for any such segmental area. 

56. An image processing method according to claim 
52 having the further improvement in which said step of 

30 effecting multiple determinations is further adapted for 
producing for each segmental area a lightness-identify- 
ing quantity that is responsive to radiance-identifying 
information for substantially every other segmental area 
of the image field. 

57. An image processing method for determining 
information corresponding to image lightness in re- 
sponse to radiance-identifying information for a se- 
lected image field, said method having the improvement 
comprising the steps of 

A. representing said radiance-identifying information 
for each of selected segmental areas of the viewing 
field, 

B. determining a selected comparison measure be- 
tween said identifying information for each seg- 
mental area and said information for another seg- 
mental area, and determining therefrom and from a 
previously-determined lightness-identifying quan- 
tity for each former segmental area a newly-deter- 
mined lightness-identifying quantity for each latter 
segmental area, said measure-determination includ- 
ing means for effecting a determination of said 
measure for each of a selected plurality of areas 
prior to effecting a further such determination for 
an area of that plurality, 

C. effecting a selected multiple of said determinations 
for said plurality of areas sequentially, different 
ones of said sequential determinations being be- 

. tween segmental areas having a spatial parameter 
different from that of the areas of other such deter- 
minations, and applying each newly-determined 
quantity of one determination as a previously- 
determined quantity in a subsequent determination, 
and further including ordering said determinations 
according to the magnitude of said spatial parame- 
ter, and 

D. producing said lightness-information for said 
image field in response to said multiple determina- 
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tions. 

58. A lightness-imaging method in which information 5 
is provided identifying optical radiance associated with 
arrayed sections of a selected image field, said method 
further comprising the steps of 

A. selectively grouping segmental areas of said image 
field a selected number of times, different ones of at 10 
least some of said groupings involving areas having 

at least one spatial parameter different from other 
groupings of areas, 

B. providing, for each grouping of segmental areas, at 
least one measure of visually significant transition 1 5 
in said radiance information between areas of that 
grouping, said measures being with reference to a 
selected lightness condition, and 

C. determining image lightness for each arrayed sec- 
tion of the image field in response to a plurality of 20 
said measures, at least some of which are provided 
for groupings which differ from one another in at 
least one spatial parameter selected from the pa- 
rameters of distance, direction and size. 

59. An imaging method according to claim 58 in 25 
which said grouping step provides at least a first of said 
groupings with areas of uniform size and provides dif- 
ferent ones of such groupings among areas having dif- 
ferent separations in terms of at least one spatial parame- 
ter selected from the parameters of distance and of 
direction. 

60; A imaging method according to claim 58 

A. further comprising the step of assigning each seg- 
mental area an initializing value of said measure, 35 

B. in which said measure-providing step includes 
providing each said measure in response to the 
product of a ratio function of the radiance informa- 
tion associated with grouped areas and the measure 
already assigned to a first of said grouped areas, 40 
and 

C. further comprising the step of assigning a replace- 
ment value to the measure assigned to a second of 
said grouped areas in response to said product- 
responsive measure. 45 

61. An imaging method according to claim 60 further 
including the step of resetting said product-responsive 
measure with reference to said selected lightness condi- 
tion. 

62. An imaging method according to claim 60 in SO 
which said measure-providing step includes imposing a 
threshold on said ratio function. 

63. An imaging method according to claim 60 further 
comprising the step of retaining the measure assigned to 
said second of said grouped areas, in lieu of said assign- 55 
ment of a replacement value, for each said second 
grouped area which is paired with an area located be- 
yond said image field. 

64. An imaging method according to claim 58 in 
which said determining step includes determining 60 
image lightness in response to an arithmetic averaging 
function of plural ones of said measures provided for 
groupings which differ from one another in at least one 
spatial parameter. 

65. An imaging method according to claim 58 in 65 
which said measure-providing step includes providing 

at least some said measures in sequence with one an- 
other and for providing sequentially-successive mea- 
sures in response, at least partially, to a preceding mea- 
sure for an area of a grouping, thereby to determine said 
image lightness in response to an accumulating succes- 
sion of said measures. 
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66. An imaging method according to claim 65 

A. in which said grouping step provides groupings 
which differ by a magnitude parameter, and 

B. in which said measure-providing step includes 
providing said sequential measures ordered be- 
tween groupings of largest spatial parameter and 
groupings of smallest parameter. 

67. In a lightness-imaging method in which informa- 
tion is provided identifying optical radiance associated 
with each arrayed section of a selected image field, and 
including 

(i) selectively pairing segmental areas of said image 
field a selected number of times, each said pairing 
being of segmental areas of identical configuration 
and size, 

(ii) providing, for each pairing of segmental areas, at 
least one comparative measure of said radiance 
information at the paired areas, and 

(iii) resetting each said measure with reference to a 
selected limit condition, 

the improvement comprising the further step of deter- 
mining image lightness for each arrayed section of the 
image field in response to a plurality of said reset mea- 
sures, at least some of which are provided for pairings 
which differ from one another in at least one spatial 
parameter. 

68. In an imaging method according to claim 67, the 
further improvement 

A. comprising the step of assigning each segmental 
area an initializing value of said measure, 

B. in which said measure-providing step includes 
providing each said measure in response to the 
product of a ratio function of the radiance informa- 
tion associated with paired areas and the measure 
already assigned to a first of said paired areas, and 

C. comprising the step of assigning a replacement 
value to the measure assigned to a second of said 
paired areas in response to said product-responsive 
measure. 

69. In an imaging method according to claim 67, the 
further improvement in which said step of pairing seg- 
mental areas includes providing different oes of said 
pairs of said areas with different spacing parameters 
ordered in said sequence from pairings of the largest 
parameter to pairings of the smallest parameter. 

70. In an imaging method according to claim 67, the 
further improvement 

A. in which said step of pairing segmental areas in- 
cludes providing said number of pairs sequentially, 

B. comprising the step of assigning each segmental 
area an initializing value of said measure, and 

C. in which said measure-providing step includes 

(1) providing an intermediate value of each said 
measure in response to the product of a ratio 
function of the radiance information associated 
with paired areas and the measure already as- 
signed to a first area of each pair, 

(2) providing each said measure in response to a 
selectively weighted averaging of the last previ- 
ously provided intermediate value for said first 
area of each pair and the last previously pro- 
vided prior measure for a second area of each 
pair, and 

(3) providing a replacement value for the prior 
measure for each second area in response to said 
averaging, thereby to determine image lightness 
in response to an accumulating succession of said 
measures. 

71. In an imaging method according to claim 70, the 
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78. An imaging method according to claim 77 further 
comprising the step of. determining image lightness for 
each arrayed section of the image field in response to an 
arithmetic averaging of a plurality of said reset mea- 
sures, at least some of which are provided for pairings 
which differ from one another in at least one spatial 
parameter. 

79. Image processing apparatus comprising 

A. means for receiving information responsive to the 
radiance values defining an image field, and 

B. means for deriving from said information a light- 
ness field containing final lightness values for pre- 
determined segmental areas of said image field, said 
final lightness value deriving means establishing 
initial lightness values for all areas of said image 
field and sequentially performing a selected num- 
ber of process steps for said image field, in each 
step of which process selected areas of said image 
field are selectively paired with different areas of 
said image field and in successive steps of which 
process such pairings of areas differ from other 
pairings in at least one spatial parameter according 
to a predetermined sequence, and in each of which 
steps such paired areas are compared to establish a 
new lightness value for each said selected area as a 
function of the ratio of its radiance value to that of 
the different area with which it is paired and as a 
function of lightness values established for such 
paired areas in a preceding process step, and 
wherein said final lightness value for each said 
segmental area comprises an effective comparison 
of information responsive to its radiance value to 
information responsive to the radiance value from 
substantially all other areas of said image field 
without a direct comparison to each of said other 
segmental areas. 

80. Image processing apparatus according to claim 79 
in which said lightness-value deriving means includes 
means for establishing each new lightness value with 
reference to at least one selected lightness condition. 

81. Image processing apparatus according to claim 79 
in which said lightness value deriving means includes 
means for pairing areas of uniform like size throughout 
at least a selected portion of said process steps and for 
selecting at least one spatial parameter for pairing, in 
successive steps, areas spaced apart by a distance that 
decreases progressively in the course of at least said 
portion of said process steps. 

82. Image processing apparatus according to claim 79 
in which said lightness value deriving means includes 
means for pairing areas of like size in each said process 
step, and for selecting at least one spatial parameter to 
decrease the sizes, in said image field, of said paired 
areas in at least selected different steps progressively in 
the course of said process steps. 

83. Image processing apparatus according to claim 79 
in which said lightness value deriving means includes 
means for selecting said one spatial parameter to de- 
crease in magnitude, at at least selected successive steps, 
in the course of said process steps. 

84. Image processing apparatus comprising 

A. means for receiving information responsive to the 
radiance values defining an image field, and 

B. means for deriving from said information a light- 
ness field containing final lightness values for pre- 
determined segmental areas of said image field, said 
final lightness value deriving means establishing 
initial lightness values for all areas of said image 
field and performing a selected number of process 
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steps for said image field, in each step of which 
■ process selected areas of said image field are selec- 
tively paired with different areas of said image field 
and in different steps of which process such pair- 
ings of areas differ selectively from other pairings 
in at least one spacial parameter, and in each of 
which steps such paired areas are compared to 
establish a new lightness value for each said se- 
lected area as a function of the ratio of its radiance 
value to that of the different area with which it is 
paired and as a function of lightness values estab- 
lished for such paired areas in a different process 
step, and in which said one spatial parameter is 
selected, for at least selected different ones of such 
pairings, to establish new lightness values for areas 
that are at least relatively small or relatively closely 
spaced apart using lightness values established for 
areas that are comparatively larger or compara- 
tively further spaced apart, and wherein said final 
tightness value for each said segmental area com- 
prises an effective comparison of information re- 
sponsive to its radiance value to information re- 
sponsive to the radiance value from substantially 
all other areas of said image field without a direct 
comparison to each of said other segmental areas. 
85. An image processing method comprising the steps 
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A receiving information responsive to the radiance 
values defining an image field, and 

B. deriving from said information a lightness field 
containing final lightness values for predetermined 
segmental areas of said image field, said final light- 
ness value deriving step establishing initial light- 
ness values for all areas of said image field and 
sequentially performing a selected number of pro- 
cess steps for said image field, in each step of which 
process selected areas of said image field are selec- 
tively paired with different areas of said image field 
and in successive steps of which process such pair- 
ings of areas differ from other pairings in at least 
one spatial parameter according to a predeter- 
mined sequence, and in each of which steps such 
paired areas are compared to establish a new light- 
ness value for each said selected area as a function 
of the ratio of its radiance value to that of the dif- 
ferent area with which it is paired and as a function 
of lightness values established for such paired areas 
in a preceding process step, and wherein said final 
lightness value for each said segmental area com- 
prises an effective comparison of information re- 
sponsive to its radiance value to information re- 
sponsive to the radiance value from substantially 
all other areas of said image field without a direct 
comparison to each of said other segmental areas. 

86. An image processing method comprising the steps 
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A. receiving information responsive to the radiance 
values defining an image field, and 

B. deriving from said information a lightness field 
containing final lightness values for predetermined 
segmental areas of said image field, said final light- 
ness value deriving step establishing initial light- 
ness values for all areas of said image field and 
performing a selected number of process steps for 
said image field, in each step of which process 
selected areas of said image field are selectively 
paired with different areas of said image field and 
in different steps of which process such pairings of 
areas differ selectively from other pairings in at 
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least one spacial parameter, and in each of which 
steps such paired areas are compared to establish a 
new lightness value for each said selected area as a 
function of the ratio of its radiance value to that of 
the different area with which it is paired and as a 5 
function of lightness values established for such 
paired areas in a different process step, and in 
which said one spatial parameter is selected, for at 
least selected different ones of such pairings, to 
establish new lightness values for areas that are at 10 
least relatively small or relatively closely spaced 



apart using lightness values established for areas 
that are comparatively : larger or comparatively 
further spaced apart, and wherein said final light- 
ness value for each said segmental area comprises 
an effective comparison of information responsive 
to its radiance value to information responsive to 
the radiance value from substantially all other areas 
of said image field without a direct comparison to 
each of said other segmental areas. 

***** 
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further improvement in which said measure-providing 
step includes providing a unity ratio in response to 
radiance values within a selected measure of one an- 
other. 

72. In an imaging method according to claim 70, the 
further improvement in which said measure-providing 
step includes producing said measure, for each second 
area which is paired with a first area located beyond the 
image field, in response exclusively to the measure al- 
ready assigned to that second area. 

73. In an imaging method according to claim 67 in 
which each segmental area corresponds to a coordinate- 
identified location of said image field, the further im- 
provement 

A. in which said pairing step provides a pairing of 
each of plural second areas with a different first 
area removed therefrom by the same coordinate 
direction and spacing, 

B. in which said step of pairing segmental area in- 
cludes providing said number of pairs sequentially, 
and 

C. comprising the steps of 

(1) assigning each segmental area an initializing 
prior measure, 

(2) updating each prior measure in response to the 
measure provided for each sequential pairing, 
and 

(3) providing said measure, for each second area 
paired with a first area located beyond said 
image field in said coordinate direction, in re- 
sponse only to the prior measure assigned to that 
second area. 

74. A lightness-imaging method in which information 
is provided identifying optical radiance associated with 
arrayed sections of a selected image field, said method 
comprising the step of 

A. pairing identically configured and sized segmental 
areas of said viewing Held differently a number of 
times and for providing a multiple of sets of said 
different pairings, each said set involving areas of a 
size different from other sets, 

B. providing, for each pairing of segmental areas, a 
comparative measure of said radiance information 
at the paired areas, 

C. resetting each said measure with reference to a 
selected limit condition, and 

D. determining image lightness for each arrayed sec- 
tion of the image field in response to a plurality of 
said reset measures. 

75. An imaging method according to claim 74 

A. further comprising the step of assigning each seg- 
mental area an initializing value of said measure, 

B. in which said measure-providing step includes 

(1) providing each said measure in response to the 
product of a ratio function of the radiance infor- 
mation associated with the two paired areas and 
the measure already assigned to a first of said 
paired areas, and 

(2) replacing the measuring assigned to each sec- 
ond area of a pair in response to said product, 
and 

C. in which said determining step includes 

(1) providing said replaced measures for each set of 
pairings sequentially for different sets thereof, 
and 

(2) producing an initializing value of said measure 
for all but the sequentially first set of pairings in 
response to the replaced measure produced with 
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the last pairing of the sequentially preceding set 
thereof. 

76. A lightness-imaging method in which information 
is provided identifying optical radiance associated with 

5 each arrayed section of a selected image field, said 
method comprising the steps of 

A. selectively pairing segmental areas of said image 
field a selected number of times, each said pairing 
being of segmental areas of identical configuration 
and size, 

B. providing, for each pairing of segmental areas, at 
least one measure of transition in said radiance 
information between the paired areas, said measure 

15 conforming to the equation: 

log vC^Mog <p(ft0) + log H*J>)-log rifKo) 

where 

log ip(x,y) is the log of the measure for a first seg- 
mental area at location (x,y) in the image field 
relative to a reference location for a second area 
paired therewith, 
log op(o,o) is the tog of the measure previously 
assigned to or determined for said second seg- 
25 mental area at said reference location (o,o) in the 

image field and paired with said first area, and 
log r(x,y) and log r<o,o) are the logs of the radiance 
information for said first and second paired ar- 
eas, respectively, 
30 C resetting each said measure with reference to a 
selected limit, and 
D. determining image lightness for each arrayed sec- 
tion of the image field in response to an arithmetic 
averaging of a plurality of said reset measures, at 
35 least some of which are provided for pairings 
which differ from one another in at least one spatial 
parameter. 

77. A lightness-imaging method in which information 
is provided identifying optical radiance associated with 

40 each arrayed section of a selected image field, said 
method comprising the steps of 

A. selectively pairing segmental areas of said image 
field a selected number of times, each said pairing 
being of segmental areas of identical configuration 

45 and size, 

B. providing, for each pairing of segmental areas, at 
least one measure of transition in said radiance 
information between the paired areas, said measure 
conforming to the equation: 

50 log npix.y) = l/2{pog op(xj)] + [log op(o,o)+ log 

><*0>)-l0g T&0))} 

where 

log np(x,y) is the log of the measure for a first 
55 segmental area at location (x,y) in the image field 

relative to a reference location for a second area 
paired therewith, 
log op(x,y) is the log of the measure previously 
assigned to or determined for said first area, 
60 log op(o,o) is the log of the measure previously 
assigned to or determined for said second seg- 
mental area at said reference location (o,o) in the 
image field and paired with said first area, and 
log r(x,y) and log r(o,o) are the logs of the radiance 
65 information for said first and second paired ar- 

eas, respectively, 

and where each said term pog op (o,o)+log 
r(x,y)— log r(o,o)] is reset with reference to a 
selected limit. 
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